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FOREWORD 



Testing in Employment and Training Programs: *An Action Planning Guidebook is orie of 
sixteen products or services developed for the Department of Labor's Office of Youth Programs 
These/products and services are intended to comprise a "full-service" technical assistance mAdel 
that can be used by the employment an'd training community to better meet the training needs of 
•staff and^CETA-eligible youth and adults. * -~ 

The contributions of the Fort Wayne (Indiana) Area Consortium, Philadelphia Office.of 
Employment an.d TrEnmrig. and Kentucky. Balance of Stat&Prime Sponsor are gratefully acknowl- 
edged. These sites participated, in the planning and pilot testing of selected products and services. 

. Appreciation also is expressed to project staff. Robert Bhaerman/Research Specialist, was the 
major author. Other staff member* include Brian Fitch, Program Director; Sandra Pritz, Program 
Associate; Bettina Lankard, Pfog'ram Associate; Gale Zahniser, Program Associate; and Wilfiam 
Goldw^jr, Research Specialist^ r • / 



« Robert E. Taylor- 
Executive Director „ 
The National Center for Research 
in Vocational Education 
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EXECUTIVE SUMMARY 

This action planning guidebook provides an understanding qf eight essential tasks in planning 
and implementing attesting and assessment program. The tasks are as follows: 

Task 1 : Establishing the assessment program 

Task 2: Analyzing participants' needs * ' \ 

Task 3:" Analyzing program services, . 

Task 4: Examining testing resources • ** * f 

Tasl?5: "-Selecting tests that-* * 

• Are compatible*with goals of the agency 

• /\re appr6priate for participants . » 
Are relevant to program services 

^ • • s ? Provide sufficient infprmation in terms of the purposes * 

V? " for fohich they are to be used 

Task 6: Setting test specifications-for individuals and groups 

'Task 7: > Using tests as tools for gathering information s 

*' > - •• Administering . * 

* • Scoring , - 

" - Interpreting . . 

4 n • Adapting to participants • % 

, ^ • 'Pretesting . . % 

Task 8r Using test results * " t 

. Planning EDPs 
1 • Counseling and instructing 

• Reporting to participants and writing other reports, as needed* 
4 • Evaluating programs and planning additional program services* 

The guidelook is intended for use by employment a*d training staff, especially test coordinators 
and administrators, counselors, and instructor* Its formatallows quick and easy reference thus 
providing these audiences with an understanding of what tasks need to be addressed and whv thev ■ * ' 
should be considered. . ^ ^ *•.-." r 

• r - . * — ^ • 

Provided in the guidebook are Abstracts describiry testing instruments that" should bfe used for 
specific measurement areas and explanations of the criteria thatjshould be used to select use and " 
interpret tfce results of tests/The guidelines and suggested activities should be useful in answering ' ' 
these and similar questions that practitioners raise*. The guidelines werfe derived'frbm a synthesis of 
much that has been written on this topic during this past -few xpars. They are intended to provide 
principles by which t$ make judgments or^de Wjnc a course of action JVence, the term "action 
plannmgj'uidehnes" is used. In light of the recent emphasis on education and world-df-work relation- 
ships, concrete suggestions for program/planning and implementation in this af'ea are vital 



The guidebook is divided into three parts. The introductory section explains th^purposesof 
^the book, defines key terms, and presents an introductory discussion of such questions as. "why 
should we test?" In the second section, the action planning guidelines are detailed; eight essential 
tasks.and sixty-seven specific activities (subtasks) ape identified. The third part includes five exten- 
sive sections called "Exploring Tests and Test Systems." In these sections, test descriptions are 
provided for seventy fc>ur tests including paper^nd-pehcU devices, comprehensive test batteries, 
rating scales, inventories, the work sample approach,*and many others. The descriptions include 
ample detail about the test formats, the stage of development of the instruments, possible applica- 
tions in an employment and training situation,' and the addresses of test publisher^. In addition^an 
extensive bibliography'is provided, as areresponses from^a survey of test users. A number of relevant 
standards for educational an^j psychological tests developed by the American Psychological Associa- 
tion also are included. 

Another major feature is the action-planning worksheets. As noted "in the guidebook, testing is 
a complex activity— in some ways an art, in some^vays a science. The worksheets are intended to 
assist test users to develop a program based upon anafysisof a number of important elements in the 
entire process. For each.oflhe specific subtasks, the user determines the steps that should be taken 
locally. ' 
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INTRODUCTION 



Pur^lbses of the Guidebook 



"Our needs are for a itiore extensive testing program. Currently 
we have a career information focus and use two achievement , 
tests, but we also need to test for aptitudes- and specific skills. 
We need to know the skills people possess that will make them 
successful. lriventories v tell you what interests someone has. 
That is fine, but we need to know more. We need f6 find out 
about career and voeational.aptitudes, Currently we 'do hot 
have that type of testing, nor do we use work samples, although 
one'of our resource centers plans to begin a work evaluation 
system soon." 

A CETA Prime Sponsor 



This view coneisely-and quite typically— expresses concerns of employment and training agency 
staff person^ working in the area dftesting, The statement also implies a number of questions 
common to such agencies; for example, what testing instruments should be used for specific measure- 
ment areas and, what criteria should be used to select and use tests and interpret the results? The 
guidelines and suggested activities will be useful in answering these and siniilar questions that prac- 
titioners raise. 

The guidelines were derived from a synthesis of the literature written on this topic during the 
past few years. They are intended to provide principles by which to make judgments or to determine 
a course of action; hence, the term "action planning guidelines" is used. In light of fhe recent empha- 
sis on education and world-of-work relationships, concrete suggestions for program planning and 
implementation in this area are,vital. c • . ' 

The guidebook is intended for use by employment an^training "staff persons-test coordinates 
and adrrinistrators, counselors, instructors, and staff trainers— a number of-whom reacted to the 
initial draft. The format— a guide for "quick usage" an?T"spot checking"-was reGommended by this 
group of practitioners. It is intended to provide these audiencefwitH an understanding of what tasks 
need to be addressed and why they should be considered. 



5/ 



Purpose^ of Testing, t 

The term testingjoften is used interchangeably with the term assessment. Both are commcifW 
"used to describe the act of appraising, evaluating, analyzing, or observing the skills, attitudes, wP- 
knowledge, intelligence, capacities, or aptitudes of an individual or group. Both terms will.be referred 
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to in thi^guidebook, although the primary'focus will be on testing. The 'following definitions describe 
the difference between testihg and assessment: 

# Testing the standardized measure or system for determining a participant's*capacity in 
different areas, for Example, vocational skiHs, aptitudes, and interests. 



^ Assessment is the process used to gather inforrnatiorr abo.ut an individual that can serve 

as the basis for determining the services or programs provided to a participant 
T . (A.L. Nellum, 1979b, p.65) " . - ** . 

• ». • * 

If testing is considered a part-of th£ initial assessment process, jt is important that the purpose^ 
for testing be sound. There are a numbed of purposes for which employment^nd training programs 
test potential participants. The ones summarized below are positive in nature in that.they can benefit 
both the participant and fh£ program by providing data on appropriate action that can be taken. 

. • Testing" is frequently conducted to determine potential for success in a program. This is* 
necessary if, for example, a training program requires that trainees have achieved a specific 
level in* reading and math«kills. A test of basic skills can determine the level of the partici- 
pant's skills. If it is determined that the participant does not possess the reqiiisite'skills, 
that participant is not screened out but is placed *in a program designed to remediate those 
skills. When the required skill level is refched, the opportunitV to enter the chosen training' 
program is once again made available. - 



Another closely related reason for testing is for placement in specific training programs. 
' Tests can be used to identify not only participants' career pr joblnterests but also their 
job-related abilities and aptitudes. It is imperative that every effort be made to align the . 
/participants' interests and abilities with skill training programs and subsequent employ- 
ment opportunities. v, c . 

• Valid and reliable tests are useful in placing participants on a job. Admittedly, ther,e is na 
fool proofv predictor of succes^; however, an*accurate assessment of characteristics and a 
knowledge of particular job requirements and, employer demands can'increase the success 
with which participants and job openings are matched. f 

* , • Use of a tfrft or tests as a counseling tool encompasses the other uses listed. Test results 4 
can be very valuable for a counselor who is interpreting them to participants and helping 
/ them make decisions which will influence the content of their Employability Development 
Plans (EDPs). Providing participants with understandable and accurate interp'retations of 
test re§i|tts, allowing them tQ consider, tjiose results, and encouraging their signjf icant input 
in the EDP z\\ are essential to participant involvement and their sense of ownership of the 
plan. This also will enhance the particfpants' level of commitment to achieve the bench- 
marks established. 

* * >* 

• Testing also can provide information for program planning arfti evaluation. The frequency 
with whitfh specific participant needs are identified (e.g., employability attitudes, job 

, skills, and the like) will affect the frequency with which such programs are offered. Tests 
♦ t that reftect participant interests and aptitudesxcan, if compatible with the demands of the 
locaf labor giarket, indicate a need for training iVj specific jobs or career cluster's and should 
be considered when planning and evaluatirft) progj^MTreiteaggs. 

As purposes for testing are being stated, \t bears mentioning that there also are purposes for 
which tests should not be used. Probably the most important is that tests should not be used to 
screen people out of a program. Frequently, when there^ are more applicants thaw program slots, 
testing is erroneously used to "Cream" applicants, placing in a program only those with the highest 
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Chances of success. The program may then be guilty of not serving those applicants iriost in rteed. 
This is not to say that applicants who do not meet the minimum entry r<equirementsWuld be placed 
in a training program. Hbwever, instead of being denied program participation, they should be placed 
in a remedial program in which iheir skills can be improved. When their skills-meet the training pro- 
gram's ^ntry requirements, they should be given an opportunity to' enroll. In this way, testing is a 
service tp participants. ^ .• [' , 4 

. This participant-centered approach implies that testing should provide participants with new 
and significant information about themselves as it relates to satisfying employment that would n6t ' 
have been available otherwise. It provides the opportunity for the participants to' formulate a clear 
'picture of their employment needs. * * t , ~ 



PLANNING FOR ACTION 



An Overview of Eight Essential Tasks 



In order to assist test users and potential users in implementing an assessment program, the 
following synthesis-a chact Qf eight essential tasks-has been developed: 



Taskl: * 
Establishing the 
assessment 
program 



Task 2: 
Analyzing 
participants' 
needs 



Task 3 1' 
Analyzing 
program 
services 



• ; Task 4: 
Examining 
■■ testing 
Resources 




Task 5:, . 
Selecting tests and testing systems that • 

• Are compatible with,goals of the agency 
7\re appropriate for participants 
Are relevant to program services 
Provide sufficient infofmation in terms of the 
' purposes for which they are to be used 







Task 6: 
Setting test specifications— 
fpr individuals and groups 


> 





Task 7: 4 • - 
Using tests as tools for gathering information 

• administering • adapting to 
; • scoring « v • participant's 

• pretesting 



• interpreting 



Task 8i 

Using test results 

-* • 

• planning EDPs ' . • « 

• counseling and instructing 

• reporting to participants and writing 
other reports, a$ needed 

• •evaluating programs and planning 

additional program services 
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The eight tasks do not necessarily foftow any rigid time pattern; that is, each should be con- 
sidered as ongoing. Establishing the program, for example, does not mean that the agency's goals are 
"written in concrete." Obviously, one should be flexible sines the needs of agencies change as donhe 
needs of individuals. Similarly, examining and selecting tests are continuing tasks. Using tests and 
test results are not th£ last two steps of the process but are part of an unending chain of activities 
that should lead to the ongoing development of assessment, guidance, training, placement, and other 
program elements. So that they stand out more easily, the major guidelines have been underlined. 

Tesfir^ is a comple$Hre£Ivit\?. It is in some ways an art, in some ways a science. These guidelines, 

therefore, are pot to be used as a programmed system. Not all of the~pomts may be applicablejm 

ev.ery situation. There also is some minor overlapping of some of the itfcms. The worksheets found 
at the end of each task are intended to assist test users in developing a program based upon analysis 
of a number of important elements in the entire process. For each of the subtasks, the user determines 
the steps that should be taken locally. Additional space may be needed for some responses. 
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ACTION PLANNING GUIDELINES 



Task 1: 

ESTABLISHING THE ASSESSMENT PROGRAMS 



1.1 Make certain thai: -the overall assessment program is in place and that the program operates as . - 
part of We agency's ovecall goals. The purposes oi assessment should be developed by all the 

^agency staff who will either directly or indirectly be involved with testing or the use of test.w 

results. Setting goals will belp/o increase the efficiency of the agency's service delivery and 
» should help to determine the cost and scope of the program. 

1 .2 Assessment should be related to the specific needs and priorities of the local agency setting. 
By paying careful attention to such issues as the effects of assessment on other service delivery 
components, the assessment program can" be constructed to fit smoothly within the entire 
service delivery operation. 1 ' • ^ 

1 .3 Identify a planning committee of those who have responsibility for testing or related progYam 

k t areas. Jhe committee's role should be to develop, monitor, and evaluate the program based on 
predetermined criteria.. In terms of implementation, o/ie key person should,fc>e identified as the 
.primary coordinator. In addition, all st^ff who will be affected by the program should be 
"involved and informed of developments."!/ necessary, consultants should be sought for addi- 
tional advice. * ^ • 

1.4 Anafyze the resources that are available, e.g., trained personnel, financial resources, and 
physical facilities. Attempt to determine, as accurately as possible, program costs in t£rms of 
these factors. , * 

1 .5 Determine whether the testing program will be conducted in-house or subcontracted to local 
agencie$?For some agencies t\}\s decision may be determined by the regulations under which 
they operate. Cost and^availability-of iri-house staff.also may be determining factors. 

1 .6^Select and train staff who will be involved in the program. Selection should be based on 

"^experjence and competency in assessment, potential for learning sych skills, interest, motiva- " 
tiqn;and sensitivity. The training shoufd be in testing methodology, and orientation to the 
life e$teriapces of the participants with whom they will be working also is of value. This will 
0 give pgrsSnnel some perspective in dealing with participants. Empathy for participants is 
extremity. important. Trailing should be made available through consultants, inservice work- 
shops,;^nd courses in tests and measurement at local colleges or universities, the United States 
Employnfent Service offices, or a commercial test vendor. 
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1 1 Make certain that the program is in compliance with the "Uniform Guidelines on Employee 
Selection Procedures/' See the Fbderat Register, Volume 43, Number 166, August 25; 1978, 
pp. 38290-38315. The guidelines have been adopted by the Equal Employment Opportunity 
Commission, in conjunction with the Civil Service Commission, Department of Justice, along 
with the prohibition of discrimination in employment practices on the grounds ? of race, color, 
religion, sex, handicap, or national origin. The guidelines are presented in the following three 
major parts: (a) general principles-including a definition of discrimination, application of the 
guidelines, and selection procedures; (b) technical standards-including items on job analysis, 
prior training or experience, and operational use of selection procedures; (c) documentation .of 
impact and validity Evidence-including items in criterion-related validity studies and evidence 
of validity from other studies. 
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ACTI6N PLANNING WORKSHEET 1 




*• 

« 

V 


The steps- that have been or should be taken locally are as follows: 

•• : 

1.1 (a) Ojur overall agency goals are: 

* * 

* 0 v 

• 


*• 


« * 


* • 
(b) The purposes of our assessment program are: 




* > 


* # s 

• V 

1 .2 Our specific needs and priorities are: 


• 

* 


♦ 


* 

1 % 3 (a) Our planning committee is made up of:*- . 

* * 

(b) Their roles are: 


* % 
# 


• 


if . V k * < . 
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1.4 la terms of staff, funding, and physical facilities, our resources are: 



\ 



1.5 Our testing program vtfill be conducted in-house or subcontracted because of the following 
^factors: . 




4 
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1.6 (a) Our criteria for selectinglstatf are: 

f . ' 



(b) Our procedu^gs for training staff are: * s . 



1.7 Our program is or is not in compliance with the "Uniform Guidelines" because of the following 
factors: 



«. ■ . A 
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Task 2; 

ANALYZING PARTICIPANTS' NEEDS 



if 

2. 1 Assess the participants' general needs by carefully considering the following dimensions: 
* • The target populations to be served * - * 

• Additional groups-if any-tt^ should be served 

• General characteristics of the participants-basic needs, backgrounds, capabilities 
' • Participant needs that can be addressed by the current mix of available services 

• Participant needs not being met or that cannot be met ' - N — \ 

, • Types of information available about participants, e,g., educational history, work 
history, prior assessment findings, and eligibility data 

2.2 The participant's performance should be jitdtjed in relation to criteria established at the local 
level. The objectives should be to determine what individuals require for employabilify and to 
target services specifically to these needs, 4 ' 



2.3 Work closely wjth the organizations that can supplement your information needs, e.g>. 
community-based organizations, church groups, welfare agencies, law enforcement ancP. ^ 
agencies, armed forces recruitment centers, and the schoohsystems. Testing* results shouid\,~ - 
integrated with existing records relating to both the strengths and shortcomings of individual A 
participants. 




2.4 Determine the overall test-taking level of individual participants. I n particular, review their 
records to determine their degree^of reading and mathematical literacy. Discuss their feelings 

„ about "test taking." It may, however, be difficult to determine true feelings. 

2.5 <Be alert to any special needs of participants. Remember that some participants may not need 
'to go through an entire assessment process; remember, too, that intake and referral involve 
jt^lgment and counseling, both of which are part of the assessment. % - 



\ 
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4 ACTION PLANNING WORKSHEET S 

Thie steps that have been or 'should be taken locally are as follows: 
p • ' * 

2.1 Our participants' general needs can be summarized in the following way: 

■ . . \ 



2.2 The specific criteria established for a participant's 'performance include the following tfTements- 

j 
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1 6 2.3. (a) Linkages have been established with the ! following organizations: 



■t: 



(b) Contacts still need to be made witb: 



' . 2.4 Tpst-taking levels of participants have been determined by a revieyv pf the fq^wing records: 



r 



2.5" The following special needs have 



te been icftntified: 
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Task 3: 

ANALYZING PROGRAM* SERVICES- 



3.1 fite/afe your program services as c/osdfy as possible to local -community needs. Carefully consider 

these important factors: the overall employment and training needs of the community and the 

nature of the spegif ic~ local labor market condjtion^tsupply and demand). 

Y • ^ , 

3.2 Assess your agency's needs in terms of program services and potential services, for example: 

• Programs, services,*Bnd resources currently available, e.g., career orientation and explora- • 
tion, work experience programs, basic skills/remediation, employability skills, job search 
skills, occupational skills training, on-the-job training, placement, apprenticeships, fpllow- 
up, follow'through h 

• Follow-up testing and counseling, especially in terms of placement ^ 
v * • Jobs^currently available for participants * * 

• Progf&m options that coUtjd be available—both short and f^ng range 

, " * • Relevant factors such as cost^time limitations, and staff capabilities for rjeedecf services 
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ACTION PLANNING WORKSHEET 3 



The steps that have been or should be token locally are as follows: 

*3.1 (a) The overall employment and training needs of the community are: 
o 



(b) .The relevant labor market conditions are as follows: 



v 



3,2 (a) Our program services consist of the following: 



(b) Our potential services are: 
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. Task 4: > 
EXAMINING TESTING RESOURCES 



C 



t ; 

4.1 Determine the measurement areas needed for your programs, for example, areas relating to: 

# t • Placement in training— interests, job-related abilities, aptitudes, attitudes, and achievement 
levels * , ^ 

• Skills needed for job placement-specific job skills, unique job requirements, specific 
employer demands, specific worker responsibilities, skills regarding special tools or 
instruments » g 

• Worker traits for jofr placement— tolerance levels, temperament, motivation^etc. 

• Counseling and guidance # * • f 

4.2 Explore the types of tests arud testing systems that are most applicable to your program and % 
participants, for example, those that appear to be most apptx>priate>for: 

• Determining participants' potential for success \^ 

• Placing participants in training programs 

• Placing participants in the apprQpriate job , 

• Counseling services , * 

• Planning programs and assessing potential services 

4.3 Examine. the tests carefully. Consider thefollowing actions: 

• Send for specimen sets. Carefully review the test manual-its purposes, technical aspects, 
scoring time* Examine the reading levels, administrative procedures, elarity of instructions, 

£ and data on reliability, validity, and norms. - 

• Read the critical^eviews of tests in the following two major resources: 

(a) Buros, Oscar K., ed. Tests in Prints I (TIP II). An Index to Tests, Test Reviews, and 
the Literature on Specific Tests'. Highland Park, NY: Gryphon Press, 1974. 

(b) Buros, Oscar K., ed. The Eighth Mental l^easuremStts Yearbook. Lincoln, NE: 
1 ' University of Nebraska Press, 1980. m \ I 

These'two volumes are comprehensive anfl should provide useful information on nearly 
every test Jthat has been published. Also see the bibliographyJor a list of o^her suggested 
readings. . 

• List the strengths and weaknesses of*testfc currently beipg used in Vourprograra— as well 
as tests which you are considering* Compare the two lists. t 

• Visit sites where testing is part of the services. Talk to other users of tesfs. See Appendix A. 

• Take the test yourself to determine appropriateness, ease of scoring, etc., 

4.4 Establish your own criteria for test selection and know,\yhat testing alternatives exist Hundreds 
of tests are available. It $gn be "mind-boggling" fof^ers to sort out the^field. In order to assist 
you in selecting tests and in setting test specifications for individuals and groups, numerous * 
descriptions of tests have been included here. Hopefully, they will aid you in analyzing available 

*' options and developing ybur own criteria for test selection. It also is recommended that test 
users become familiar with the standards for educational and psychological tests developed by 
the American Psychological Association. See Appendix B for a partial listing. 
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The steps that have been or should be taken locally aVe as follows: 
4.1 (a) . The primary measurement areas for which we need to test are: 



(b) Additional areas that should be considered are: 



r 



4.2 The types of tests^aritMe! 



sting systems that are most applicable to olr partisioa 
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4.3 The following activities have been conducted: ' 

• Sending for specimen sets ' 

• Reading test reviews 

• Listing strengths and weaknesses of current— and potential— tests 

• Visiting sites and talking with otjier users 

• Taking the test ourselves 

4.4 After reviewing the detailed descriptions of tests, the following criteria have been established 
for test selection: , , * * 
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Task 5: 


SELECTING TESTS AND TESTING SYSTEMS THAT 


• 


Are compatible with goals of the agency 


• 


Are appropriate for participants 




Are relevant to program services 


• 


Provide sufficient information in terms of 




the purposes for which they are to be used 



5. 1 Tests should be selected in Ugh t of the participants your agency serves, how your agency operates, 
and the types of services provided; in short, tests should be selected to fit local circumstances. 
Every test has its own special uses, strengths, and limitations. It is important to view tests a^ 
inspirations for ideas and not necessarily as "shopping lists" from which tools can be selected 
without careful examination. The primary tasks are to know your needs, your participants, and 
your tests. 

5.2 In selecting tests, attempt to meet the needs of all who are involved. Particular consideration 
should be given to .the employment needs of the local community as well as to organizations 
providing the participants with the needed services. 

5.3 ^ests should relate to particular occupational areas. For example, scales on an interest inventory 

should relate to occupational requirements; attitude and value scales should relate to work 
situations. 

* «. 

5.4 The selection of tests is based largely upon the purpose they will serve; hence, there should be 
a reason why a particular test is given to each patticipant. Each device should serve a practical 
purpose; however, be sure not to overtest. With respect to the time it takes to administer a test, 
the length of time should be based on the participant's needs rather than the program needs. 

5.5 The participant's background, literacy level, and willingness to undergo testing should influence 
the types of techniques selecte^L Some instruments can better accommodate a particular partici- 
pant^ characteristics. In one research study of the assessment q£the disadvantaged by the Mark 
Battle Associates (1976), 144 instruments were tested; each may be valid under specifrc circum- 
stances. 

J* 

5.6 Often several tests will be needed. A range of instruments should be available— ior low-literacy 
participants, for those interested in a skilled or technical occupation, for those who need addi- 
tional a&demic training, and the like. Two important questions to ask are: what do you want 
to find out about the participants and what test^will give this information.. Remember that no 
single measure will be as accurate as multiple measures. This does not necessarily mean that 
many tests need to be administered but that test information should be compared* to participant 
estimates, staff observations, and interview information. If multiple sources provid^discrepant 
data, further information will be needed to reconcile these discrepancies. ^ 

5.7 Attempt to select instruments that relate to realistic career planning, that is, tests that have * 
some value in predicting' training and occupational success. Also remember that there are no 
infallible test instruments; some tests are more valid than others. 
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5.8 Costs, reusability, and sophistication of the staff should help guide test selection. 

5.9 The United States Employment Service (USES) suggests points to keep in mind when selecting 
tests: \ . 

• They (the tests) must be occupational/y oriented ff they are to be useful in vocational 
counsel ing-and selection. 

* „• To the extent possible, they should be oriented to the USES "Dictionary of Occupational 
Titles" used by placement interviewers and counselors. 

\ + They mttst be useful with the wide variety of targel groups: young and old, the well- 
educated and the educationally deficient, inexperienced applicants for entry jobs and 
experienced and trained applicants? applicants for the skilled trades and for semiskilled 
and laborer jobs. 

• They must be simple to administer and score; the results must be readily interpretable. 
(USES, Report No. 3*1, 1977, pp. 1-2). 

5.10 Be wary in selecting "projective tests. ".Many experts feel that these tests are not appropriate 
except as a cjinical instrument and often only for therapeutic purposes. The Mark Battle 
Associates' report (1976) cites ohe expJert who notes that projective responses can be meaning- 
fully interpreted only when the examiner has extensive information about the circumstances 
urrder which they were obtained and the aptitudes an^l experiential background of the examinee. 
The report indicates that while projective techniques can be useful under certain conditipns, 

* such tests are highly questionable for training and employment programs. 

3. 1 1 Analyze the strengths and weaknesses of traditional paper-and-pencil tests. When compared to 
locally constructed tests, standardized paper-and-pencM testWgquire no staff time for develop- 
ment; many will yield scores that can be compared^vith those of other groups. However, since 
some significant shortcomings are evident, it isjflrfportant to be aware of the problems inherent 
in using these tests. The following list sumnpafizes these major shortcomings: 

• Individual test items may be at a relatively high reading level and may reflect cultural content 
of which the disadvantaged have little knowledge. 

• Some tests*do-not seem to bear any significant relationships to the individual character- 
istics pertitjfent to job success for most of the jobs the disadvantaged will be seektrtg 
(Backer 1979b, p. 6). 

• Most of these tests are similar to classroom. tests with which many disadvantaged persons 
have a history of failure, ^nd which, therefore, may make them feel anxious and uncom- 

• fortable. » • 

" * Some tests have written directions at a reading level higher than that of the test taker. If 
^directions are not understood, the test measurement may not be valid. 

J^Some disadvantaged persons have limited experience with tests of any kind and do not 
have the "test wisen'ess" important to yielding test results that fairly- estimate character- 
istics and capabilities. - • % 



Item content designed far children but administered to adults may be simple enough in, 
reading Itvel but uninteresting or insulting. (Backer 1979b, p. 6)/' 
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5. 1 2 Analyze the strengths and weaknesses of work sample systems. Work samples are standardized 
job performance tasks designed for use primarily in developing the.employability of disadvan- 
taged individuals. The technique consists of the work samples, a structured environment in 
which they are performed, and evaluations of behavior based on Observations. A most thorough 
analysis of work samples was prepared by Botterbusch (1980). Anyone responsible for select 
ing a commercial system should read this analysis. His major points are paraphrased below: 

• Investigate the range and type of jobs that are available in the local labor market and 
the training opportunities available to participants. 

• Check the final report format of the work sample to determine what information it 
contains; decide what needs to be included ih these areas and then find or develop the 
evaluation tools that bfest fit the participants' needs. 

• Know the reasons why you wish to purchase the system. Probably none will meet all 

the needs in terms of jobs and training. A facility, however, could develop its owq evatu- \ 
ation based on job or work samples taken from local industry, (pp.. 1-4) 

Botterbusch also discusses the possibility of carefully selecting individual wOrk samples from * 
several systems and combining them into a unified systerff specific to the needs of the facility. 
He suggests that the purchased system could t»e integrated with facility-constructed devices, 
other evaluation systems, on-the-job evaluation, and psychological tests. 

5.13 Be sensitive to the data on reliability, validity,* and group norms. While Bruno (1978) states 
that one should not hesitate to use an instrument simply because it has not been proven 
beyond a doubt to be valid, the Mark Battle Associates study (19*76) notes that tests lacking 

. Jn job-related validity have no place in selection and placement testing programs. 

% The purpose of test validation is to establish an objective and standardized instrument that 

measures or predicts the behavior of individuals. Such standardization and objectivity enables 
the user to compare individual test scores with a norm and to eliminate factors tjiat would 
create test bias. Since no test is completely bias-free^it is important to examine how the test 
was constructed and with what groups of people the norms were established. .The Mark Battle 
Associates study suggests that this is particularly important for employment and training 
programs that serve a diverse target population, in- order 'to ensure that all persons— regardless 
of racial, cultural, or ethnic background— have an opportunity to participate in all types of 
- programs. Since tests areyseAin arriving at decisions that may have great influence on the 
ultimate welfare of tho^te^ted, test users should be sensitive and should apply high staridards 
of professional judgment in selecting and interpreting tests. Producers have the responsibility 
of providing sufficient information about eadh test so that users will know how reliable a 
test is for their purposes. The Mark Battle Associates study recommends that CETA prime 
sponsors who include testing in their- programs ensure a test's validity for the groups with 
which it is to be used.* 

•i 

\ . 

*For concrete examples of how to check reliability and determine validity, see McCaslin and Walker's 
A Guide for Improving Socially Developed Career Education Measures, R and D Series No. 167, 
The National Center for Research in Vocational Education, The Ohio State University, 1979. 
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ACTION PLANNING WORKSHEET 5 

The steps that have been or should be taken locally are as follows: 
5.1 Local circumstances that might affect our selection of tests are: 



•r 



5.2 The speqific needs of the employment community-and service providers— in relation to test 
selection are as follows: 



\ 



/ 



5.3 The following occupational areas are relevant to the tests being considered: 
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5,4 The specific purposes of the tests to be selected are as follows: 



/ 



5.5 The followj ngt ests appear to accommodate our participant characteristics: 



5.6 Resources exist to enable us to purchase number of tests or testing systems. 



5.7 The following career planning elements are being considered in selecting tests: 



X. 
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5.8. The followi'ng^factors have been considered to assist us in selecting tests: — 
Costs 

Reusability of materials • > 
Staff backgrounds 

5.9 The following selectiorfcritega also have been considered: 

Orientation to occupational areas 
Orientation to the Di&tionary of Occupational Titles 
Relevance to target groups- . #( ' 

Ease^of administering, scoring, and interpreting 

5.10 The following "projective tests" are being considered (carefully) fpr possible use in the 
following way: * \ 

■9 




5.1 1 (a) The following are the major strengths and weaknesses of the paper-and-pencil tests 
currently being used; 



\ 



(b) The following appear to Be the major strengths and weaknesses of the tests being 
considered:- 



s 
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5.12 (a)- The following are the major strengths anc^yveaknesses of the work sample systems 
currently being used: 



(b) The following appear to be the major strengths and weaknesses of the systems being 
considered: 



5,13 (a) The most important data on reliability, validity, and group norms of the tests we are 
using currently are as follows: 



(b) The most important data on reliability, validity, and group norms of the tests we are 
considering are: , ^ 
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Task 6: 

SETTING TEST SPECIFICATIONS FOR, 
PARTICIPANTS— INDIVIDUALS AND GROUPS 




6.1* Establish individuar'jobjectives for assessment. Each participant ^^ Id be treated as an t . . 
^ individual. Participant involvement in setting objectives is important. Participants often a^e 
well aware of what information about their vocational needs, interests, and abilities may - . 
be relevant to thfir employment objectives. 

6.2 Decide what other specific information is needed about participants prior to testing. Also 
decide whether some (or all) df the Information needed about an individual may^be obtained 
<ttfrough testing and whether a partyyjlar test is useful in obtaining information for some. (or 
all) of the participants. 

6.3 Determine which types oftests are needed for participants in various situations. Set specifi- 
cations for each participant. Sorjie examples 

• A test for mechanical aptitude . . . that d6es npt require atiigh reading level 

• A test for literacy for a low functioning participant . . . that does not require a high 
reading level * ' 

• A noQverbal test of general learnjng ability . . . that is available4& Spanish 

Determine each participant's test-taking ability, whether thfrtest takers are "high literacy" or 
"low literacy " in reading and mathematics and, as in some cases with disabled persons, whether 
the tests need to be^da^ted or modified. 

The idea of custom tailoring assessment to fit each participant is an important one and should 
b&'caref ully explored. Individuals having similar needs could be tested in groups— as long as ' u 
each person is treated uniquely, as long as individual needs are considered, and as long as the r 
instrument lends itself to group use. * 

* ? • •<>' 

6.4. Provide participants \/Ah the exact reasons for selecting each test For^example, explain what 
, a "sales aptitude" test measures and how the results relate to a variety of sales jobs. Also; „ * 
explain how results will be used, exactly what the results are, and what they mean. 
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* ACTION PLANNING WORKSHEET 6 

The steps that have been or should be taken locally are as follows: 

6.1 The following objectives 'have been established for individual participants: 
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6.2 Other information items needed about^wrticipants include the following 



J 
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6.3 Vest specifications for participants include the following factors: 



6.4 The reasons for using a test have been shared with the participants. These include the 
following points: * 
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~ • . , Task 7: 

USING TESTS AS TOOLS FOR GATHERING INFORMATION 

• Administering H • Adapting to participants 

• Scoring • Pretesting orientation . 

• Interpreting 



7. 1 Use tests with appropriate caution and have them administered by qualified % personneL Mangum 
and Walsh (1980), for example, suggest that no assessment tool has yet bSen devised that 
captures all the nuances of motivation, that tests the reaction of the individual to situations not 
yet experienced, or that is foolproof. They note that assessment is a useful tool to be used with 
due caution and healthy skepticism. 

7.2 Be aware of "what works" for others. Research on testing indicates that severarpractices work 
vyell. The following examples were reported byMangum and Walsh: 

• Collecting as many existing records as are available on each person enrofled in the 
proc/rani - . 

• Maintaining closertlnkages vyith agencies, especially the schools, which are likely to 
maintain files on enrollees * 

• Testing in conjunction with other program components, e.g., orientation, prevocational 
training, and counseling 

7.3 Adapting tools as the situation calls for it. Backer (1979a) indicates that many assessment 
techniques mayjiot be usable without appropriate adaptatiorj^rogram developers may need to 
use basic criteria for evaluating such techniques when determining whether a device they are 
thinking of adopting needs to be adapted. He points out, for example, that some users of the 
Comprehensive Occupational Assessment and Training System (COATS) have found that not 
all components are relevanyfo their needs. Adaptation\jlay consist Of deleting one or more 
components. Backer also notes that "adaptation is a process that proceeds at the adaptor's 
peril unless ca rejs takfii w see that there is integrity to what remains and that the information ^ 
lost by eJiminating or changing certain portions is information the agency can afford to lose" 
(p. 46). 

7.4 Use pretesting orientation materials as needed. These materials help reduce participants' 
anxiety, increase understanding of how the assessment will proceed, and help establish its s 
relevancetb later employment and training services. Through the use of pretesting materials, 
it fe,often possible to identify individuals for^ whom standard paper-and-pencil tests are inappro- 
priate because of low reading levels. These persons may be guided into alternative procedures 
(e.g., interviews, work sampling) in which their lack of experience^with testing will not inter- 
fere with,an effort to identify job-related personal characteristics. 

7.5 Tests should be given when a specific purpose or ratiopale has been established. Assessment 
traditionally is viewed as a process that is completed early in the program. Nevertheless, 
assessment information should be collected throughout the sequence. This is important for 
two reasons: v continuous assessment can provide a more accurate indication of a participant's 
skills, abilities, interests, and work attitudes; and it also can assist staff in their efforts to design 
.effective activities for training and job placement.. . J 
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A number of factors should be considered in'deciding when during the process testing is to be 
done. The program applicant generally has little motivation for involvement in the program. 
It is important not to let too much time lapse between the initial application and the adminis- 
tration of the test. Another reason for avoiding a time lapse is that many applicants have a 
history of poor testing experiences and will be more inclined not to show up for a testing 
session if the fear of testing is allowed to build for several days. Tests should be scheduled in 
such a^way that they can be scored and the results used in counseling as soon after the testing . 
as possibfe. This immediate application is another factor in keeping participants from dropping 
out of the-program. . * 

^ * 7.6 Train your staff in the use of tests. A trained, sensitive staff is essential. Some devices, particu- 

larly work samples, offer training for people purchasing ihe materials. Training in the use of 
paper^end-pencil tests is included in graduate work in the field of psychometrics. The training 
required for use of the United States Employment Service developed tests, the GATB and the 
NATB, may be obtained through the local state employment security agency office. A tester's 
knowledge of "real world options" will help put the use of test results into a concrete frame- 
work and also is an essential part of test interpretation. 

7.7 Clarify the responsibilities of test coordinators. The following are possible areas of responsibility: 

• Provide leadership in selecting and scheduling tests. «' 

• Evaluate new tests and make recommendations for or acfainst the use of a particular 
test. * , 

• Requisition the necessary materials and distribute them to examiners. 

• Traifj^xaminers and proctors in administering tests. 

• Make arrangements for sq^ring and providefenalysis of scores. 

7.8 Specify the concrete duties of those who administer tqsts. Jhe following are sample duties: 

• Read the entire /nanual. This is essential if it isVhe first time the tester has adminis- 
l % tered the instrument. 

• Take the test yourself. Read the directions, see how to mark the answers, note the 
time limits. 

• Provide a supportive atmosphere for the testing situation. 

• Have all the materials assembled for quick distribution. 

• Read all directions to participants clearly and distinctly. 

• Make sure the test takers understand what they are to doVbefore they begin. 

• Allow time for questions. * 

, • Follow timing procedures. 

Observe the test takers. Make certain they understand the instructions, .that they are,y 
/ on the proper page, and that their answers are in the designated places. 

•\ Assign proctors if there are large numbers of persons taking the tests. 



7.9 " Score each instrument accurately. If a test is hand scored rather than computer scored, it is 
important to have well-trained staff to scor§~the testing devices. Periodic d©uble*checking on 
scoring accuracy is desirable. „ 
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7.10 Interpret grade level scores-with extreme caution. Throughout the literature on testing, the<> 
.concepts of grade levels and competency levels are discussed. It is important to consider 
these^poncepts carefully. The testing,and reporting of reading and mathematics skills on the 
basis eft grad§ levels often are viewed as a poor approach tp testing; ( however, it is generally 
acceptttjas the best technique currently avaiJable. An alternative is to use tests that are based 
* on the actual skills required by specific occupations. This is especially helpjful if results are 
used to place participants ooithe job or ir\a Skills training program. In order to assess occupa- * 
tionally related competence, instruments need to be used that reflect those competencies. 
Competencies-both basic skills andattitudinal-can be identified witb significant input from 
private sector employers who probably know better than anyone else what skills are essential % 
for one who wishes to work in a specific occupation. „. 

There are a'number of advantages to occupationally relevant testing. The first is that the use 
of such tests usually indicates the parallel use of an individualized competency-based occupa 
tional skills training program. It also is reasonable to assume that the development of such 
instruments wogJd follow or be done in conjunction with the development of individualized 
competency-based skill training. Another advantage is that it allows participants to begin 
training at the level needed rather than at a level they already have surpassed. This type of. 
testing also can be used to measure student progress in a training program that is individualized 
and competency based. 
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ACTION PLANNING WORKSHEET 7 

The steps that have been or should be taken locally are as follows: 

•7.1 The following specific cautions are applicable to our local situation: 



7.2 The following practices are being adhered to: 

• Collecting existing records ' 

• Maintaining linkages m 

• Testing in conjunction with other program components 
7.3. The following adaptations of instruments are being considered: 



7.4 The following pretesting orientation materials are being used or being considered 



fro 



* 7.5 (a) The following times for assessment have been established: 



(b) The .rationale for these time periods is as follows: 



(c) The following amount of time generally elapses'between the-time the initial application 
is made and the time tests are administered. 



(d) The follbwing amount of time generally elapses between the time when the tests are 
scored and when the results are used in counseling sessions: 

o \ 
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7.6 The following provisions. have been made forstaff training: 



7.7 e following responsibilities of test coordinators apply to our agency: 



4 



7.8 Tfte following dutfes have been specified for test administration: 



4^ <T 
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7.9 Scoring of tests is done by the following method and is double-checked periodically by: 



7.10 (a) The following procedures are adhered to in interpreting scores: 



(b) In addition, the following approaches are considered when interpreting tests: grade 
level scores*an<tcofHpe|ehty levels. * ' ? 



Our position'on/fnis jsSue is as follows: 1 



44 



C 



Task 8: 

USING TEST RESULTS 

Planning EDPs 

Counseling and instructing 

Reporting to participants and writing 
other reports as needed 

Evaluating prpgrams^and planning 
additional program services 
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y\ 8.1 The use of test results involves a number of important activities. Backer (1979a) includes the 
following: 

• Debrief the participants following the completion of testing. 

• Prepare the assessment report. 

Provide feedback to the counselors, instructors, and other relevant staff. 

• Provide for the storage of whatever records are necessary for follow-up with the 
participants, program monitoring, and evaluation. 

• Evaluate assessment programs and recommend improvements based on evaluation 
results, (pp. -38-39) # r 

8.2 Share the results with participants who must understand what results meag and how they 
might reflect on their future goals. The importance of feedback cannot be overemphasized. 
Provide participants with information that enables them to make better judgments aboutt 
themselves. The process should be done in conjunction with'participants. DOring the "de-* 
briefing," participants may provide additional information that will help in understanding the 
results. This also will help allay their anxiety and'provide an opportunity for initial counseling 
about the use of the results. Use a team approach in working with participants, such as 
involving counselors, instructors, and participants. 

^ - There also is another important type of feedback, namely, feedback.to the intake and assess- 
ment unit. Once the participant has been tested and enrolled in a program, seldom does this 
unit hear anything more. However, a constant feedback would allow the^taff to adjust their 
procedures or alter their approaches needed. 
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f se the results with, appropriate caution. Do not.overgeneralize. Tests, like all other tools, r^eed 
to be handled with great care. The following points should be kept in mind: 

• Results should not be permitted to limit unnecessarily the options available. Many 
tests are reasonably good measures of the "threshold ability" td perform a particular 
tesk. A number of experts point out that scores beyond this threshold have little 
capacity to predict work or training performance. In such instances, scores should not 

^ , be used beyond thfe level for which validity can be established. j 

*" * 

• Tests should not exC/ud^anyone from the program but should be used toVdentify 
areas in need x of development 

• Tests can be used to increase understanding about how an individual's characteristics 
might relate to the requirements and satisfaction potential of available jobs, as well as 
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/to explain the problems that might be created by low test scores, including employer 
rejection. In sorge instances, it is useful to give the participants practice in test taking 
so that they ca^i improve their scores and avoid unfair discrimination based on their 
lack of experience with particular types of tests. * 

• Tests should be interspersed with other types of information gathering. 

8.4 Use the results as an aid in develop'^ Employability Qevetopjnent Plans (EDPs). In order to 
implement the participant's initiatives, employment and training agencies are required to design 
programs that formulate local achievement standards or benchmarks for participants, develop a 
long-term employability plan for each, track development through individual achievement 
records, and match services with the participant's developmental stages. 

The concept of "developmental assessment" is being'used with increasing frequency. The term 
* describes the process of determining each participant's strengths anct weaknesses relating to 1 
basil: comp^encies and the capability of the program for meeting identified needs, selecting an 
appropriat^service strategy, and measuring progress periodically. Measuring gains in competency 
areas and progress toward goals is essential. MeasuremeRtshould occur periodically, including m 
at the time^f completion 6f each service unit. Reassessment involves feedback and may lead to 
the revision of £ participant's EDP. „ j 
I f • / 

A related concept, "developmental life span," implies that assessment cannot be isolated from 
one's total development.*The orocess contains measurements pat relate to an individual's total 
life' span. Thus, assessment datl should relate to the*level oi<jjevelopment at various identified 
stages of vocational readiness; ihepreVocational, tfite vcrcational education and training,. the job 
v or production realization, and thsU^feer enhancement phases. The approach irbased on sequen- 
tial growth as an individual progresses from ph^se to pha$p, requiring that certain competencies 
be acquired before one moves to the next step. Assessment cuts across each phase. Therefore, 
counselors attempt to establish a "participant's assessment matrix" for each participant. Once 
the matrix is completed, an EDP that prescribes the services appropriate for remedying the 
identified employability problems for each individual can hp developed and implemented. While 
the nature of these plans\aries, all EDPs should be based upon carefully administered and inter- 
preted tests. 1 

8.5 Share results and interpretations with instructors of the various training programs. Inform the 
instructors of the indicated strengths and weaknesses of the participants and, to the extent 
possible,' whetherJhe participants can "handle" the* instructional material, Be as specific as 
possible in describing, traits but remember that the results are only indicators and not "hard and 
fast" descriptors. 

i • 

8.6 Evaluate the effectiveness of the assessment techniques. The following criteria have been suggested 
by Backer (1979a): * * » 

• Soundness and relevance of assessment results for decision making 

• Impact on service delivery (measured in terms of*stated objectives to provide counseling, 
training, or placemerlt) 

» . » 

• Cost of the assessment technique or prograrp (including costs of acquiring and imple- 
menting the technology, staff tipne and fatties, 2nd the amount of time it takes to 

* . complete the' assessment process), * 
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• Timeliness with which assessment results are provided in relation-to other aspects of the 
service delivery operation 

• Agency staff acceptance of the procjram and its result*- 

• Client acceptance of the program and its results 

« 

\ • Unexpected payoffs and negative side effects, such as delays in other aspects of 

service delivery because of the need to assess at a certain point in the service delivery\ 
* # process (pp,8-9) * 

Tests also can be used effectively for evaluating overall program effectiveness, e.g., standardized 
reading tests used as a measure of the effectiveness of remedial education programs. Tests also 
can provide usefQl measures of attitude change when this is a program goal.. 
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ACTION PLANNING WORKSHEET 8 



The steps that have been or should be taken locally are as follows: 

8.1 The following uses of test results are being made: ^ 

• Debriefing participants- 

• Preparing reports 

• Providing feedback to counselors, instructors, and others 

• Storing recQrds for later use 

• Evaluating'assessment programs and recommendingjmprovements 

• Other: 



8.2 (a) The results of tests are shared with the participants: 

• regularly 

• seldom 
p • not at 



(b) The results of tests are shared with the intake and assessment unit: 

• regularly 
* • "seldom 

• not at all ' • , 



8.3 The following cautions are being considered in our use cff test .scores: *l 




8.4 Thg following results are being used in EDP preparation: 



v i 



8.5 The instructors of various training programs receive the following information on-test 
results and interpretations: * 
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8.6 The following 'data are being used in evaluating the effectiveness of the assessment techniques: 




» * 
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EXPLORING TESTS AND TEST SYSTEMS- 



Charting the Alternatives 



As guideline 4.4 indicates, sorting out the testing options can be a "mind-boggling" experience. 
In order to make this tasteomewhat more manageable, the following chart has been prepared. Test" 
descriptions are included imthe five sections following the chart. Each test has been assigned a number, 
for example, A.2-the Basic Occupational Literacy Test (BOLT) is described in Section A and is listed 
as test number 2. 



AREAS OR 
MEASUREMENT 



TYPES OF TESTS 



TARGET 
AUDIENCES 
(if indicated) 



TITLE OF TEST 



SECTION REFERENCE 
AND TEST NUMBER 



Academic skills: 

• competency 
application 

• corftmunity 
resources 

• occupational 
knowledge 

• consumer 
economics 

•'health 

• government 
*^and l§w , 

Academic skills: 

• arithmetic -> 

• reading * * . 

Academic skills: 

• arithmetic* 

• vocabulary . 



paper-and-pencil 



»paper-and -pencil 



paper-and-pencil 



adults • 
youths 



educationally 
disadvantaged 
adults 



Adult Performance 
Level Program: 
Adult and High 
SchooLSurveys 



C. 32 



Basic Occupational ^ 
Li|e^acy Test (BOLT) 

GATB/NATB \ * 
Sqreening Device 



\ 



A. 2 



A. 6 



Academic skills: 

• vocabulary 
dreading 

• spelling 

• arhhmetic 



paper-and-pencil ' " acfults 



Adult Basic Learning' 
Examination (ABLE) 



A^ 1 



Achievement: ^ 
* • reading 

• mathematics 

• language 



paper-and-pencil 
achievement 
-battery 



adults-low 
reading levels 



Test of Adult Basic' 
Edu'cation (TA§E) - 



C. 52 



Achievement: 

• reading • 

• spelling 

• arithmetic 

Achievement: 

• verbal 

• numej/cal 

Aptitude and 
achievement 



paper-and-pencil 



tape recorded 



paper-and-pencil 
battery 



participants with 
limited reading 
skills 



Aptitudes: 

• learning ability 

• verbal aptitude 

• numeneftw 
' aptitude 

• spatiaf^aptitude 
fcform perception 

• clerical 
perception 

• motor 
coordination 

• finger dexterity 
•'manual 

dexterity 

Aptitudes: 

• judgment i 

• comprehension * 

• arithmelid 

i 

Aptitudes: ^ 

• intelligence" ^ 

• verbal aptitude 

• numerical 
aptitude' 

• spatial aptitude 
'• form perception 

• clerical* 
perception 

• motor 
coordination 

• finger dexterity* 

• manual 
dexterity 



paper-and-pencil 



pap'er-and -pencil 
imprehensfte battery 



co 



paper-and-pencil 
test battery 



disadvantaged 
applicants 



Wide RaAge 
Achievement 
Test (WRAT) 



Fundamental 
Achievement Series 



Dailey Vocar 
tional Tests: 

Technical 

Scholastic 

Spatial 

Visualization 

Business 

English 

0 

GATB: General 
Aptitude TesfBattery 

SATB: General 
Aptitude Test 
Batteries 



6. 55 



A. 5 



<C. 37 



E. 72 



/ 



Flanagan Aptitude 
Classification Tests* 



NATB: Nonreading 
Aptitude Test Battery 



C.^39 



A. 11 
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Aptitudes: 

• motor ^ 
•spatial 
•clerical 

• perception 

• numerical 

• verbal 
? ' -- — 

Aptitudes: 

• personal-social 

• mechanical 
•general sales 

• clerical routine 

• computational 

• scientific 

Aptitudes: 

• verbal reasoning 

• numerical 

• abstract 
reasoning I 

• space relations 

• mechanical 
reasoning 

• (flerfcal speed 
' and accuracy 

• spelling 

• language usage-** 

Autobiographical 
information 



work samples 



rehabilitation 
population 



paper-Mid-pencil 
bffte 



test bfltery 



paper-and-pencil 
battery 



biographical 
questionnaire 



disadvantaged 
applicants 



MicroTOWER 



D.62 



Aptitude Tests 
for Occupations 



C. 33 



Differential 
Aptitude Tests 1 



C. 38 



Biographical 
Information Blank 



A. 3 



Clerical skills 

Clerical skills. 

Cognitive skills; 

• job knowledge 

• job seeking r 

• reasoning 

• interests 



typing, dictation, 
spelling 

paper-and-pencil 

paper-and-pencil 
battery 



disadvantaged 
youth 



Clerical Skills Tests 



General Clerical Test 

Program for Assessing 
Youth Employment 
Skills (PAYES) 



E.73 

B.25 
A. 14 



Coping-skills: 

• behavior styles t 

• .activity preference 
*• values 



self-description 
inventory 



Job Analysis and 
Interest Measurement 
(JAiM) 



C. 43 



Interests 



checklist 



r Self-lnterview 
Checklist 



A. 15 



Interests 



checklist/ 
interviewing aid 
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, InterestChecklist 
(U.S. Employment 
Service) . 



E. 74 



Interests 



paper-and-pencil 



youth, adults 



Kuder Occupational 
Interest Survey 



Interests 



interest inventory 



youth 



Ohio.Vocational 
Interest Survey 



Interests 



Interests 



paper-and-pencil 
inventory 



visual, n on re ad i 
format 



males only 



youth 



Minnesota Vocational 
I nteres^rwenj^ry 

Picture Interest 
Exploration Survey 
(PIES) 



Interests 
and aptitudes 



Interests 
and attitudes 



Interests: 

• occupational 
preferences 

I nterests: ^ 

• basic? 

• occupational 

Interests, 
experiences, » 
2nd skills 

Interests: 

• preferred 
activities 

• competencies 

• se I Estimates 



self-administered 
checklist including 
a survey of basie 

Zl Is (experimental) 
per-and-pencil 
inventory /visuals 0 

interest inventory 



paper-ahd'Pencil 
inventory 



J3aper*and*pencil 
inventory 

4 

self-administered 

scales 
> 



disadvantaged 
clients 



vocationally and 
college-oriented 



r *youth and adults 
including 
rehabilitation 

youth 

! 

youth and adults 
including * 
rehabilitation 



Job Interest and 
Literacy Level 
Evaluation Instrument 
(JILL) 



n 



Wide Range Interest- 
Opinion Test (WRIOT) 

California Occupational 
Preference Survey (COPS) 

c 

Strong-Campbell Interest 
Inventory ' , 



Vocational Interest, 
Experience, and Skill 
Assessment 

Self-Directed Search 



Job matching, 
employability 
attitudes, 
work samples, 
livipg skills 

Jot^reference 



Job performance 
factors, e.g.., 

• speed 

• accuracy 

• mechanical 
aptitude 

• personality 
variables 

• attitudes 

• job aptitudes 

• skills 0* 



multi-component 
assessment system 



self-reporting 
questionnaire 
(experimental) 



work sample 
battery 



youth and adults, 
'including rehabili- 
tation participants 



physically and 
emotionally 1 
disabled 



^56 



Comprehensive Occu- 
pational Assessment 
and Training System 
(COATS* 



Tolerarjce^tp 1 " bureau- 
cratic Structure Scale 



Testing Orientated n 
and Work Evaluat ion in 
Rehabilitation (TOWER) 



54 



Job readiness 



Job-specific 
skills 3 

'* Job-specific 
skills: 

* •folding 

• pasting' 

• stuffing 

• stapling 

• packing 

• measuring 

• collating 

• partem 
making 

Knowledge -of 
specific aspects 
of occupations: 

• trends «r 
terminology 

• traming 

Manual dexterity 



% Manual dexterity 



Mechanical v 
ability: 
• sensory/ 
mechanical 



v paper-and-pencil 
Spanish version 
(experimental) 

work samples 



wojjk samples 



k special needs 
population 

sevetely disabled 
-mentally and 
v physically X 



paper-and-pencil , youth 



individually 
administered 
apparatus 

individually 
administered 

paper-and-pentif, 
visuaMSpanish . 
edition) 



Vocational 
Opinion Index 



Singer Vocational 
Evaluation System t 

Wide Range Employ- 
ment Sample Test 
% (WREST) 



A. 21 



Knowledge of 
Occupations Test 



Crawford Small 
Parts Dexterity Test 



Hand-Tool Dexterity 
Test 

* Benqett lyiechanical 
Comprehension Test 



4 



D.64 
t 

D.71 



C. 45 



B.23 

B.26 

\* C. 34 



Mechanical 
aptitudes: 

• knowledge 

• space relations ' 

• shop arithmetic 

Mental ability: 

• analogies < 

• arithmetic - 
m problems 

• judgment 

• following 
^ directions 



paper-and-pencil 



paper-and-pencil 



adults in business 
and industrial 
situations 



SRA Mechanical 
Aptitudes 



Wonderlic Personnel 
Test 



B.29 
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Multiple factors: 
•simulated" 6 

• assembly process 

• interests 

• interpersonal/ 
social skills 

• independent 
living skills 

Multiple factors: 

• general ability 

• Specific aptitudes 

• achievement r 

• values 



assessment techniques' mentally retarded 
eUsmg different 
formats 



paper-and -pencil 



Pre-Vocational 
Readiness Battery 
Valpar 17 



Vocational Planning 
Inventory t 
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Multiple factors: 

• interests 

• temperaments 

• Aptitudes 

Multiple factors: 

• job perceptions 

• tolerance for 
behavior 
variability 

• employee 
relationships 



work samples 



interview forms 
(experimental) 



* explicitly designed 
' for disadvantaged 



Vocational Interest D. 69 

Temperament and 
Aptitude System (VITAS) 



Mandell NYC Programs A. 10 

Interview Forms 
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Multiple factors! 

• personality 

• job behaviors 
and attitudes 

• job satisfaction 

• job expectancy 

.Multiple facjors: 

• self-concepts 

• self ^acceptance 

• reading 
comprehension 

• personal behavior 

Multiple factors: 
••verbal cognitive 

• sensory 

• motor abilities 

• integration* 
(coping) 

Oral directions 



Perceptual and 
dexterity ability 



personality 
variables 



test battery 
(experimental) 



paper-and ^pencil 

questionnaire 

(experimental) 



work sample's 



cassette tape/ 
record 

battery of tests 



preference 
schedule 



severely disad- 
vantaged participants 



Colorado Battery 



A. 4 



mentally retarded, 
learning disabled 



mental levels above 
trainable mentally 
retarded 
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. Jorgensen Inter- 
personal Relationships 



McCarron-Dial Work 
Evaluation'System 



Oral Direction Test 

Talent Assessment 
Program (TAP) 



Edwards Personnel 
Preference Schedule 



A. 9 



D.eV 



A. 12 



D. 65 



> B.24 
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Psycho-physical: 

• unilateral 
motor ability < 

>• bilateral 
motor fbility 

• perceptual-motor 
coordination 

• Intelligencer 

• achievement 

• physical strength* 

Reading atiflity 



Self-awareness; 
• values 
•needs' 



psycho-physical 
tests 



paper-and -pencil 



orientation 
inventory * 



all intelligence levels, 
physically disabled 



technical or 
vocational trainees' 



Hester Evaluation 
System (Phoenix 
Ability Survey System) 



D.59 



Industrial Reading Test 

Hall Occupational 
Inventory - 



C. 42 



C.4J0 



Self-awareness: 
" • occupational 
choices . 

• future plans 

• values 



paper-and L pencil 
inventory 



3 



Harrington/O'Shea 
System for Career 
Decision. Making 



C.41 
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^short rating scales 
(experimental) <» 



work samples 



Self-perception: . 

• focus of 
/ control 

• need for 
. achievement y 

d Skiil>jd , 
. aptitude: 
•'size 
discrimination, 

• numerical 
sortmg 

• range of motion 

• clerical 

• problem solving 

• sorting 
.•Emulated * 

assembly 

• coordination ' 

• soldering 

-Skills:' . 

• self-evaluation 
and developmjht 

. • carearewa renews 

• decision making 

• employment 
seeking 

• work -effectiveness 

• personal economics 



Test-taking ability miniature test 
battery \ 



papef-and-penal 



."general pppulation* 
'{industrially 
injured workers) 



*y"duth and adults 



(pretesting 
orientation) 
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Tseng Rating Scales 



>Valpar Component / 
VVbrk Sample System 



A. 19. 



• ■ •••:•) 

•Career -Skills Assessment 



Pretesting Orientation 
Exercises (LJ.S* 
Employment Service) 



D.67 



C. 36 



A. 20 



m 



Test-tefking 
ability 

Values, interests, 
"aptitudes , 



Vocational 
competence: 

• motor skills 
°* cognition 

. • responsibility 
' • social-emotional 
behavior 

Vocational needs: 

• authority 

• independence 
♦-responsibility 

Work attitudes 



Work attitudes' 

• adjustment 

• satisfaction 

Work attitudes: 

• goals ■ 

• beliefs 

• intentions 

Work behaviors: 

• tolerance for 
criticism 

• independence 

• co ope rati o*h 

• motivation 

• concentrations 

• punctuality 

• safety aware- 
ness and habits 

Work components: 
sorting . 

• assembly 

• • basic tools , 1 

• building 
maintenance 

• clerical 

• construction 

Work motivation 



practice 
materials 

self-assessment 
rating scales 



rating scale 



paper-and-pencil 
inventory 



self-administered 
paper-and-pencil 

paper-and-pencil 
inventory 
(experiment?!) . 

paper-and-pencil 

questionnaire* 

(experimental) 



' rating scale 



-work samples 



(pretesting 
orientation) 

Youth 



mentally retarj^pd 



Test Orientation 
Procedure 

Rating ScSl^s for 
Vocational Values, 
Interests, artek^ptitudes 

San^Franciscb Vocational 
Competency Scale 



Minnesota Importance 
Questionnaires 



Work Ehvironrhent 
Preference Schedule * 



WIN trainees - 



mentally retarded Work Behavior 
* Rating Scale * 



handicapped and 
^disadvantaged 



Vocational Skills 
Assessment'andy 
Development^rogram 9 
Brodhead-Garrett 



A. 17 
C. 49 

B. 28 



C. 46 



B.31 



Wojk-Relevant Attitudes A. 22 

Inventory 



Goodwin Work A. 7 

Orientation Questionnaire . 

t 



B. 30 




D. 70 . 



interview format 
(experimental) 



IndikWork Motivation 
Scales 



A. 8 
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Work skills: 

• clerical 
•machine 

• craft 



work samples 



mentally retarded 



Vocational Information 
and Evaluation Work 
Samples (VJEWS) 



work saniples , 



Worker trait 
groups: 

• handling 

• sorting 

* • inspecting ■ 
f measuring 
•tending 

• manipulating 

• routine checking 
and recording 

• classifying and 

* filing 

• inspecting and 
stock checking 

• craftsmanship 

• costuming 

• tailoring 

• dressmaking 

• drafting ' 



Worker trait groups organizing 
from the Dictionary frameworjc/ 
of Occupational - 
Titles 



disadvantaged a«d Jewish Employment and 
physically disabled t Vocational Service Work 
Sample System (JEyS) 



packet for work 
sample evaluation 



y 

c 



disadvantaged and System Approach £o 
disabled participants" Vocational Education 
(SAVE) . • 



* 

%.NOTE: The descriptive terms used in 'the categories are, for 1h# mosVpart, 



those of the test publishe 
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SECTION-A: 

, EXPLORING THE RESOURCES IN " 
CLIENT ASSESSMENT:^ MANUAL FOR 
EMPLOYMENT AND TRAINING AGENCIES* 
VOLUME II (Backer 1979b) 



V 

One of the primary sourceifpr exarhrning tests an^testing systems is the analysis by Thomas 
Backer of test instruments for the disadvantaged. His fqcus wason both paper-and-pencil tests and 
work sample systems. However, since these systems were dealt with iagreater detail by Botterbusch, 
this section reports mainly on the paper-and-pencil test? Backer reviewed. However, it also includes 
one work sample system (SAVE) and two sets of pretesting orientation materials. 

1. Title of Test: ADULT BASIC LEARNING EXAMINATION (ABLE) 

• • /> * • 

X 

Description: Measure of basic learning skills, using subject matter drawn from adult life 

Format: The test include^ a vocabulary test, dictated so that no reading is required; an 
arj|hmetic problenrvsolving test, which can either be dictated or taken in bow^ntional reading 
and response format; and a short screening test, called "SelejctABLE," for use in determining 
'the most appropriate level of ABLE for each adult apfplicant. Thr^e levels of the ABLE battery 
are available, each geared to a particular educational level. Levefs 1 and 2 require about two *° 
hours' administration time, and Level 3, about three hours. Scoring can either be by hand or 
(for Level 3 only) through the publisher's cbmputer scoring service. 

Stage of Development: ABLE wds developed tp provide a general intellectual aptitude screening 
tool for use with disadvantaged adults, one that overcomes the traditional shortcoming of tests 
for low reading level involving items geared *to children rather than adults. Extensive normative 
data and a test manual kre-available from the publisher, ajthougff there is no mention of the 
availability of validity data. 

Application: General screening for determining -training* needs or placement options • 

Access: Available from the Psychological Corporation, 757 Third Avenue, New York, NY 10017 

* " t * . . * 

*Q Title of Test: BASIC OCCUPATIONAL LITERACY ^TlBOdlT) 

Description: Test of basic reading and arithmetic skills for use with educationally disadvantaged 
adults % * f * 

Format: On the BOLT, reading skills are assessed by a reading vocabulary subtest and a reading . 
comprehension subtest; arithmetic skills are assessed by in arithmetic computation subtest and 
an arithmetic reasoning subtest. The subtests are available at varying levels of difficulty. The 
test may oescored either by hand or by using machine-scoring answer sheets. * * 

Stage of Development: The BOLT was developed to measure aptitudes using test-item content 
that is relevant for adults rather than children. The BOLT wide-range scale isAJsed to indicate 
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what level B0LT subtest should be administered to a given client. Jn the BOLT manual, detailed 
information about test development, normative data, reliability data, and an in-progress vali- 
dation program are given. 

* <• 
Application: General screening for determining training needs or placement options 

*■ 

Access:. Information on availability -of the test, answer sheets and test manual, as w&lj^s the 
wide-range scale for determinatkjn of appropriate.BOLT subtests, can be obtained from state 
Employment Service offices. - 

Title of Test: BIOGRAPHICAL INFORM A TION BLANK (BIB) . . . 9 * 
Description: Brief questionnaire eliciting autobiographicalYJata from the examinee 

t 

Format: The BIB is a questionnaire form containing, in its present stage, 66 items of biographical 
information in the following categories; home and family situation— past and present; high school 
experiences and perceptions; work history including job ?u mover record; present job responsibili- 
ties and.obligations; preferences and needs regarding work, the work place, and income; life goals 
and philosophy; self-image^and time # organizatfl*^{Ta "bits. Itemspwere specifically constructed for 
use with subjects reading on fourth- to sixth-grade l^e js^JV Iuch of the life-hfstory d?ta that BIB 
requests may be objectively verified, discouraging cheating or conscious distortion! On the other 
hand, since there are no right or wrong answers in the traditional sense,,those having negative 
experiences with tests may be less threatened by the BIB. The BIB can be scored routinely by 
clerical personnel using scoring keys developed by the test's creators. — 

Stage of Development: Th^BIB was developed under a ^search contract from the Department 
of Labor by Rfchardson, Bellows, Henry & Company, Inc. (FTBH) and has been used in predict- 
ing length of participation in the Job Corps and for predicting job tenure among Employment 
Service applicants. In a study completed in 1975, the BIB was used to predict (1) three-month, 
employment tenure among disadvantaged Employment Service applicants who had received no 
previous employment and training agency services prior to job placement, 'and (2) completion 
of job entry stages among Work Incentive program enrollees. Results of this stu.dy irttijcated 
thatpersons scoring higher on the BfB were more likely to remain employed or to complete 
job entry on the WIN program at significantly higher rates than those in the low?r score groups. 
In the various research reports mentioned Iby Backq:), substantial evidence about the reliability 
and validity of the BIB is available, along with some normative data. . ' 

Application: RBH advised the use of the BIB as a tool for identifying those most likely to 

benefit from services in* WIN programs; by analogy, other seriously disadvantaged employment 

and training agency applicants could be identified using such a system. However, there are still 

some problems with the BIB that employment and' training agencies would need to consider 

carefully before making operational use of the Instrument at this tim^. 4 
* * 

First, there was evidence, from RBH's own research, of reluctance by a number of the 
experimental participating cities to use the BIB as a patf of the service process. Clearly, sub- 
stantial education of employment and training agency staff's may be required to convince those 
who would have to use the BIB that jt would be likely to have value and'to give them careful 
training in its proper use. 
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Also, it is not clear from the research conducted so far whether the'BIB is really picking 
out those individuals most likely to benefit from a particular service delivery process. In fact/ 
because high scorers on the BIB may well be persons who would be likely to get a job even 
without receiving services, usirig the BIB as a selection tool (with a high score selecting into 
the program) may actually select for service those who need it least , "* 

Also, since the use andnonuse cities in the 1979 study were allowed to seJf-sfilect, there 
is no reliable way to identify and measure what other variables may have been operating in 
promoting a higher pe rentage of employment for those cities that used the BIB scores versus 
those that' did ftot yf I ' H,/ 

" On the plus side, th^BIB' has oow been administered to a very largegroup of seriously . . 
disadvantaged individuals. It has been refined a number of times, as have its scoring procedures. 

Access: 'Richardson, Ballows, Henry & Company, Inc., 1140 Connecticut Avenue, N.W., 
Washington, JpO20036„ * » ' 

« 

7700*0/ Test: COLORADO BATTERY , • 

Description: Series of tests developed by theColorado State University Manpower Laboratory 
for use in work with the severely disadvaotaged 

Format: The Socia/ Access Questionnaire fSAQ) contains 89 items measuring six personality 
factors. It also contains questions about personal history. Items are either multiple-choice or 
use a bipolar licjrae-disagree answer scale. This test was designed to tap social and personality 
characteristics that contribute to "job deviance." Subjects fill out the measure either individu- 
ally or in large groups. The Work Requirements Rating Scale is a#7-item questionnaire dealing ^ 
with behavior on the job and is'designed to measure the consequences of differing vocational 
attitudes among worker, supervisor, and employer. The Importance Questionnaire is a test of 
20 items relating to job corj^tiohs pr opportunities, each rated on a spale of from very important 
to very unjnnportant. The Employment Satisfaction Questionnaire hjas 20*items measuring job 
satisfaction on a scale from very linsatisfied to very satisfied, (items were taken from the*Minne- 
•sota Employment Satisfaction Questionnaire). The Job Conditions Questionnaire is an.eight-page 
questionnaire concerning perceived work environment. The Job Expectancy Rating is a single- 
page rating form for evalyatiorilby workers of* six basic job conditions. JJfieJob Importance 
^Prediction Scale is£ 12-item scale filted out by^ Workers and supervisors to check for congru- 
ences and discrepancies, between the two groups regarding inrtportant job conditions. The Self- 
Acceptance Questionnaire is a 15-item yes-no measure of highly loaded self-evaluation i^emsA 
e.g., concerning respondent's sexual behavior The Similarity Scale is an 80-item checklist ' 
measuring identification with militant or activist groups. *~ 

Altoparjt of this battery is the revised Miskimins Self-Goal— Other Discrepancy Scale 
(RMSGO), which was discussed in Backer (1972) as being inappropriate for use with the 
severely (disadvantaged and it, therefore, will not be discussed here. 

These forms and instruments are presented in a Research Manual (Manpower Caboretory) 
that includes a copy of each device plus information concerning form, structure, intended use, 
mode of administration, reliability, and validity data. < 

Stage of Development: These instruments were developed under funding from the Department 
of Labor and were reported in a series of final report volumes on the multifaceted research 
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project calfed "Applied Programs in Marifpower Development." To the writer's knowledge, 
they are not presently in use, and the data base supporting them is quite limited. 



Application: These instruments would primarily be useful as an idea source for employment 
and training agencies. \ * \ — £ 

' J 

Access? Copies of the Research Manual may be available from ttae U.S. Department of 'Labor. , 

. c 

Title ef Test: FUNDAMENTAL ACHIEVEMENT SERIES (FAS) 

Description: Two tape-recorded tests for use with individuals having limited reading skills, 
tapping knowledge and capabilities that an applicant may reasonably be expected to have- 
acquired in the coarse of ordinary cteily living 

Format: The FAS-VerbaJ is a'30-minute test; it measures the ability to read signs, use telephone 
directories, and recogcyze and understand commonly used words. The FAS-Numerical alsp takes 
30 minutes to administer; it measures the ability to tell time, recognize numbers, understand 
calendars, and solve numerical problems. The tape recordings ensuWaccurate-timing and identical 
presentation to all wtfo take the test, eliminating examiner bias. Integrated question booklets and 
answer sheets are.provided. Scoring procedures and other details^ administration are presented 
in a manual available from the test publisher. ^ 

Stage of Development: The Fundamental Achievement Series was developed fc^r use in selecting 
applicants for job-training program's and covers the range from basic literacy to slightly above the 
eighth-grade level. Information on normative, reliability, and validity 'data is available in the 
publisher's manual. ' , • 

Application: For use as a basic screening device in employment and.training agency service 
programs ^ * — 

Access: Available from the Psychological Corporation, 757 Third Avenue, New York NY 10017 

i ' . • m * - 

fide of Test: GENERAL APTITUDE TEST BATTERY AND THE NOIWEADING 
APTITUDE TEST BATTERY (GATB/NATB) SCREENING DEVICE 

\ ' ' ' ' < . ~ < 
Description: A brief written test consisting of the wide ; range scale of the Basic Occupational 

Literacy Jest for use in determining whether a particular service applicant should be givenjthe 
GATB or NATB 

; > 5, 

Format:, The test consists of arithmetic and vocabulary items and is scored using two stencils. 
Further information on administration and scoring procedures is available in the Manual for 
the GA TB/Nfi TB Screening Device. ' ' 




Stage of Development: Details on development and use of this device alscLa]££pesented l n * " 
the 1973 Manual. These include cutoff scores to be used in determining whether a.given applkant 
should take the GATB or NATB. 

Application: For employment and training agency assessment programs where both the SA1 
and NATB may be administered, to determine which test a given applicant should take . 
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Access: Infonmation about availability *of the test, scorin^stencils, and the Manual can be 
obtained from state "Employment Service offices. * * — 

Title pf Test: GOODWIN WORK ORIENTA TJUN, QUESTIONNAIRE* 

-* * » 

Description: Questionnaire designed to measure work orientations of WIN trainees 

Format: The Work Orientation Questionnaire was devised to measure attitudes, £oal^ beliefs, 
and intentions with respect to the wortd of work, The questionnaire consists of several sets of . 
questions about work that are to be rated on four-step "ladders" ranging, for exampfe, from 
"agree" to ' / disagree.'".Both a s^ff-administering form and- a home-interview forrrV, with questions 
read by.ttie interviewer, have been crekfed. '* * 

Sfctfe Development: Data hav$ b^^^thered on some 1400 WIN trainees and were factor- 
analyzed to yield oldsters of items defMff^.work orientations. Goodwin ^suggests that/with 
appropriate refinement, ihe Work Orferitatioh Questionnaire might be used to help WIN staff 
acquire more accurate perceptions of their trainees' work orientations foy subsequent use in 
counseling and placement. x ' V* * 

Application: Since this instrument was developed only jftfca prelimhary research study and no v 
extensive reliability or validity data are avaMable, ft *houf$ be coffttlered primarily as a source 
of ideas for use in employment and training situatio^&^here measurement of work orientation 
may be important. ,4 . , \ > * -° ' \ 

Access: CQpies df the research report are available from Dr. Leonard M. Goodwin, The Brooking°s 
Institution, Washington,. DC 20036.- 

Title of Test: INDIK WORK MOT/VA TLON SCALES 
If 1 , ' 

escription: Interview- format test designed to estimate work motivation 

© 

Format: The interviewer reads a collection ot statements and asks the interviewee whether 
he/she agrees'strongly, agrees mildly, is undecided, disagrees mildly or disagrees strongly. Also, . 
data are collected by having the interviewee^hoose one of four possible endings to unfinished' 
statements read by the interviewer. Six areas of mQtivation are assessed: the^otive to work, 
;tfie motive to avoid work, the expectancy to work, the expectancy to avoid work, the incentive * 
to work, and the incentive to avoid .work. In a research study, Indik found that these scales were 
mqdestly reteted to training and placement success for MDTA enrolled. Animportant finding 
was that the motivational characteristics that seem to facilitate stable employment are not 
necessarily those that facilitate success in training. No further work with this instrument appar- 
ently has been conducted, a\nd normative, reliability, and validity data are not available. 

Application: Since this instrument has received only research use so far, it would primarily ba 
a source of ideas for employment and training agencies concerned with the measurement of 
motivation to work. • ; 

/ 

Access: Copies of the research report are available from Dr. Bernard Indik, Rujtgers Univer- 
sity, New Brynswick, NJ 08903., o 
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9. Title of Test: JORGENSEN INTERPERSONAL RELA TIONSHIPS SCALES 

Description: Two instruments designed for.a research study of the relationships of interpersonal, 
facility to placement success 

Format: The Social Vocabulary Index consists of six scales: (1) the Self-Concept Scale, a t 
20item1est of opinions of self consisting of statements begirding with "I am . . ."; responses % 
are chosen from frequency alternatives (most of the time-hardly ever); (2) the Self -Acceptance 
Scale, a 20-item adjective checklist; (3) the Ideal Self Scale with the same items as the self- 
" concfept scale except that the statements are stemmed "I would like to be . . ."; (4) Concepts of 
" 'Others Scale with the same items but stemmed "Other people are . . ."; (b) a Vocabulary Scale . 
designed to measure subjects' reading comprehension; and (6) a Social Desirability Scale con- 
sisting of 33 statements about personal behavior which the subject is asked to rate true or false 
for him/herself. 

The Revised Interaction Scale, the other instrument used in this study, is a two-part 
/ paper-and-pencil questionnaire that is used by both counselor and counselee to rate the counsel- 
ing interaction. # 

Stage of Development: In a study using the two instruments with rural rehabilitation cliepts, 
significant differences in test scores were found between females who obtained their own jobs 
and'those who had^cement assistance. These modest results suggest some possible utility of 
the measures f^redicting which clients need placement services. No other normative, reliability, 
or validity evidence is available. r~* s ^ 

Application: Since thisThstrument has been used only in research, it would primarily be a 
source of ideas for employment and training agencies concerned with measurement of inter- 
personal relationships as a component of success in obtaining a job. 

Access: These instruments are available from G.Q.. Jorgensen at the University of Utah, Salt 
Lake City, Utah 84112.. *' - 

10. Title of Test: MAN DELL NYC PROGRAM INTERVIEW FORMS " v 

Description: Interview forms designed to gather data about job perceptions of Neighborhood 
Youth Corp (NYC) enrollees . 

Format: Questions for enrollees are phrased in simple language in these instruments. Since 
" interviews are conducted individually, the interviewer is permitted to adapt wording of 
' questions to thefcespondent's level of understanding. The forms used include a general section 

for all groups-erf subjects, with separate background forms for enrollees and supervisors and 
' employers bf NYCXenrollees studied in this research. One of the study's purposes was to com- 
pare enroHee'percefrtiqns with those of supervisors and employers. During the interviews, data 
were collected for trie following variables from supervisors and employers: skills, tolerance for - 
behavior variability.^eVtiployer-employee relationship, supervisor-employee relations, and 

employee benefits./ 

I > 

Stage 'of Development: These interview forms were developed for research uses only, and no 
validity, normatjv.e, or reliability data are available. 
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Application: The potential utility of these survey forms for otTier assessment purposes does * 
not seem to be very great, although they could be used in certain assessment programs for 
obtaining perceptions of applicants regarding job-related variables*- 
• •* 

Access: Copies of the research report are available from Dr. Wallace Mandell at Wakoff 
Research Cente>, Staten Island, NY, 

1 1 . title of Test: NON READING, AI^TITUDE TEST BA TTER Y 4N^TB) 

Description: The NATB consists of 14 tests measuring the same nine aptitudes measured by 
the GATB. 'It was developed for use with individuals who do not have sufficient literacy skills 
tto take the GATB. 

Format: The NATB measures aptitudes in the following areas: intelligence, verbal aptitude, _ 
numerical,aptitude, spatial aptitude, form perception, clerical perception, mo\ov coordination, 
finger dexterity, and manual dexterity .'Apparatus tests are used for measuring finger dexterity 
and manuaf dexterity, and the other test portions are designed for paper-and-pencil format. It 
requires about 3V* hours to complete; some of its subtests involve no reading or vocabulary 
skills at all. Others use familiar stimulus objects with which even the most seriously disadvantaged 
should be familiar.; The NATB manual contains information on administration, scoring, and 
, /interpretation. Paper-and-pencil test booklets and answer sheets are integrated, and machine 
scoring is available through National Computer Systems in Minneapolis. 

Stage of Development:^ The NATB was originally developed in recognition of the shortcomings 
of the GATB for use in employment and training agency services to the severely disadvantaged. 
Extensive normative and reliability data are. available, and validity studies have been-under way 
for some time. 

Application: The NATB* is an instrument of choice, particularly when the GATB/NATB 
Screening Device is used, .for seriously disadvantaged applicants in employment,and training 
agency service programs where a general measure of intellectual aptitude is required. * 

Access: Information about availability of NAf B and associated manuals and scoring materials 
can be <?btained from state Employment Service offices. 

1 2, Title of Test: ORAl DIRECTIONS TEST 

Description: Direct measure of an ^applicant's ability to understand anc^follow oral directions 

Format: * The applicant responds by marking the answer document in\accordance with 
instructions dictated on a cassette tape or record. It requires 15 minutes to administer and is 
also available in a Spanish-language version. \ J 

Stage of Development: The Oral Directions Test was developed as an aid to\|lecting more 
able workers among applicants having a limited education and among applicants with limited 
knowledge of English. According to th&iest publisher, it is suitable for selecting applicants 
for maintenance and service work in public institutions, transportation systems, stores, hotels, 
etc., as well as in factories and shops. Information on normative, reliability, and validity data 
is available in a test manual. 
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Application: This test may have some applicability in employment and training agencies for 
use as a general Screening device. • 

Access: Available from the Psychological Corporation, 757 Third Avenue, New York, NY 10017. * 

1 3. Title of Test: PICTURE INTEREST EXP LOR A TION SURVEY (PIES) 

Dekription: A career interest inventory presented in a visual, nonreading format \ * % , 

Format: The PIES is designed to help in the investigation of individuals' vocational infects j 
and to apply this information to pursuing 5 career goals. A PIES test kit includes 1 60 color stifles, 
2 slide trays, 1 audio tape, 2 sefs of career reference-cards, 1 student-teacher manual, and 50 j 
/esponse meets. Colored 35mm* slides are utilized t& depict '12 specific careers within each of ; 
1 3 career clusters. The career-cluster system is based on .the Occupational Outlook Handbook j 
and is cross-referenced to the Dictionary of Occupational Titles. Each slide shows a worker's 
hands performing a task considered to be representative of a particular occupation within a V; 
career cluster. Users indicate interest in a patticulac career by circling the number of that slide 
on their response sheet/The survey may be administered individually, in a group, or self- ' 
administered. Users may determine their own "score," or interests, by simply counting the > 
number of items they circle^ and then determining which career cluster contained the most items 
marked. Because hands are depicted performing tasks, the developer of PIES clairpsa minimum 
of distraction or bias in occupational selection due to physical attractiveness of 'the workers'or 
ethnic, sex, or racial characteristics. 

Stage of Development: PI ES has been developed primarily for use with adolescents, and a, , , 
validation study by Eubanks was conducted using this population. Normative, reliability, and' 
validity data are Available in Eubanks' report. Validity was assessed using a concurrent measure 
(comparison with othervocational interest test scares), and there is to ( dat<! no concrete evidence 
as to the actual effic9jcy of PIES in predicting career selection or facilitating the career-counseling 
< process. ^ , . 

^Application: Employment and training agencies dealing with youth service programs might 
consider using PI ES as a career exploration or counseling tool, although it lacks clear validity < r 
data'.- ' . . 

Access: P|ES is-avaTtqble from Education Achievement Corporation, P.O. Box 7310, Waco, 
TX 76710. 

14. Title of Test: PROGRAM FOR ASSESSING YOUTH EMPLOYMENT SKILLS (PAYES) 

Description: A battery of seven tests designed specifically for use with disadvantaged youth 
in guidance pounseling y • . ' 

. . {Format: PAYES consists of thfSe separate booklets: Booklet 1 contains three attitudinal _ 
measures; Booklet 2, three cognitive ones; and Booklet 3, a vocational interest inventory. Job- 
holding skills, attitude toward supervision, and self-confidence are the three major attitude 
areas covered. Cognitive measures of job knowledge, job-seeking skills, and practical reasoning 
„ are also surveyed.. -The measures are designed for adolescents and young adults with to w verbal 

- * * skills- pictures heip to clarify many of the questions presented.. The pictures in this "unisex" 
test battery are designed so that all items are equally appropriate for males and females. 
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PAYES is administered orally to small groups jn an'informal mahner. Student* mark their 
answers directly in a test booklet. The measures are scored locally, using scoring directions 
provided, so that counselors can get quick score results. • 

Stage of Development: PAYES is ba/ed on aserifessrf research and test-development studies, , 
undertaken by Freeberg and his colleagues at Educational Testing Service, resulting in the 
development and experimental application of the "ETS Test-Battery foe Disadvantaged Youth,' 
^described in Backer (1972), 

. > i 

J The original test-development effort, sponsored byjthe Department of Labor, began with^ 
a logical analysis eoncerning test format. Backer (1 972) reviews these test-development proce- 
dures. Subsequent research included developing criteria for test validation and a longitudinal 
validation study. Results from validity studies to date have been modest, but available evjdenre 
does suggest that the measures may have some potential for use in guidance work with djsadvan 
taged youth. * n * 

At the present^time, a revised version of a.user's guide for PAYES'is being prepared, as is a , 
*technjcal manual that will provide a fairly comprehensive discussion of the rationale for the test 
constructs and their design. This manual also will summarize results obtataed in the validity 
studies mentioned above. Four of the seven measures (job knowledge, jobriolding skills, job- , 
seeking skills, , and self-confidence) are currently in use nationwide by the" U.S. QepartmenLof 
Labor for program evaluation purposes*with longitudinally obtained samples of youth program 
enrollees. The evaluations include collection of postprogram outcome data and, thus, provide an 
opportunity to develop larger-scale norms and to look at predictive validitiesjor the four' 
measures. Updated validity information will be fed into subsequent reyfsions oT^he technical 
manual. • \ ^ ; 

Application: I n the user's guide for PAYES, it is explicitly stated that the battery should not 
be used to determine program participation, nor is .it to &e thought of as a substitute for coun-" 
seling but rather as a supplement to it. The PAYES guidance battery is seen by its developers as 
£ tool that deals with aspects of basic employment training copsidered essentijJJn most voca- 
tional and work training programs. Further validity, data will be needed in ordirto establish 
that JiAYES can have a significant impact on guidance decisions. 

i 

Access: The tes^battefy, administrator's manual, and user's guide are available from Cambridge 
ffook Company, 888 Seventh Ave., New York, NY 10019. 



Title of Test: SELF INTERVIEW CHECK LIST (S/CL) / * . 

Description: Vocational interest checklist*for use in the Cleff Job/Man Matching System 

Format^Exavn'mees, complete this checklist without supervision, indicating Isehavioral units of 
^work'tconceptualized along the dimensions "things, people, and ideas") they like best and 
dislike most; then they indicate those they have done most and those tney have done least T^he 
checklist is scored to pfoduce ttoo applicant profiles: one describes activities preference, the 
other activities experience, arranged according to 16 dimensions or worl<. Results can then be 
compared with data on the characteristics of the jobs, organized along tfie'same basic dimensions. 

s2$$vf Development: Initial development of the Job/Man Matching-Systerh and th^SICL are 
descn»fed. Conceptual underpinnings of this system, and its application in a number of settings, 
are givftn by Cleff. The latter publication includes details Stt&everal validation studies that have 



been completed usini) the Job/Man Matching System. Reliability datawo are provided. Infpr- 
mation is given on an operational system for the Cleff Job/Man Matching process that includes 
computer analysisland profiling of results, based both on information (Rthered about applicants 
from the SIC j. and information collected about jobs. Uses of thi^ approach, With a number of 
adaptations as required for local circumstances and different types of clients, are given for an 
employmenl^and training agency (Cincinnati), private industry, and an adaptation byJ^REP, 
Inc. (See description of COATS.) A separate validation study of the Job/Man Matching System 
also is describee!. 1 



'Application; The Cleff'Job/Marf Matching System (CJMS), and the Sej^merview Check List 
(SICL), which is the basic instrument foe gathering client data, haveTeceived sufficient research 

* attention to be ready for operational use in employment and training settings. The reader is 

referred t^the description of COATS for what is, perhaps the best-developed application of this 

approach. * - v 

— ■ * 

Access;^ Available from Dr. Samuel Cleff at the 'Center feft Human Technology, Princeton, NJ. 

» 

16. Title of System: SYSTEM APPROACH TO VOCATIONAL EVALUATION (SAVE) 

Description: Framework for organizing work sample type vocational evaluation of disadvantaged 
and disabled service recipient^. J 

Format: The SAVE package consists of a compact manual with simple, step-by-step instructipns 
' and a supply of forms needed for vocational evaluation with reference t9 47j/vorker*trait groups 
from the Dictionary of Occupational Titles. 

Included in the package are evaluator instructions, sample*figures for easy use of forms, 
work sample operation sheets and equipment lists, norms'and validity information, and DOT 
reference material. The kit include^suggested requirements for setting up work samples to 
evaluate each of the DOT areas required for a given.assessment effort. The test pubHisher^suggests 
that most needed materials will appear already in schools, evaluation facilities, or industrial arts* 
classes. Administration of the full system requires about 14 1 /i hours, and adequate training * 
generally is afforded by careful reading of the materials in the SAVE packacjfe. 

, t Stage of Development: TheSAVE package was developed primarilyto-provide a relatively easy 

* and inexpensive way to obtain vocational evaluation information organized according to;thtf 
* schema* within 'the Dictionary of Occupational Titles. The£AVE approach is unique in that 

commercially available work samples can be substituted for many of its components; thus, SAVE 
can be used as a framework for setting up a vocational evaluation work sample system in a variety 
of formats. Some limited data on reliability and validity are presented in a related study. . 

Application: The SAVE approach to vocational^valuation is Relatively inexpensive and may ... 
haye some applicability to employment and training agency settings in terms of planning-and 
organizing a work sample-typ6 assessment system. Evidence available/for this report was^oo 
* Y sketchy to indicate whether the system can le Cised as more than a source of ideas arid planning 
tools. fc 4 "* € " * 

* Access: Available from SAVE Enterprises, P.O. Box 5871, Ronte, GA 30161. 

. r . r., ' ' ' . • • \ . 
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1 7. Title of Pretesting Orientation Material: TEST ORIENTA TION PROCEDURE 

Description: Practice materials designed to help applicants-learn how to take tests 

Format: The Psychological Corporation's multimedia pretesting orientation materials are 
'intended to serve as a preface to any kind of vocational assessment or selection testing.,Jhe 
aim is to reduce anxiety and increase "test wiseness" by offering practice in taking tests. The - 
j materials, designed for-group administration, "guidethe group through a halMiour session of 
easy tejf-lilce exercises in a 20^page practice bo<&let. A tape recording is used to provide direc- 
tions jnd explanations. A Second 20-page'booklet with simila'r test materials is then provided 
for further take-home practice prior to the actual testing experience. There are five tests In all- 
speed and accuracy* spelling, vocabulary, arithmetic, and information. There also is a job " 
application form for the individual to fill out. * • * 

Stage of Development: These materials have been well developed and formatted.and have beef^~^~~ 
available for some years through the test publisher. 

4 

Application: As part of a preassessment procedure* the Test Orientation Procedure might be a 
useful component of an overall assessment system in an employment and training agency, 

Access: Available from the Psychological Corporation, 757 Third Avenue, New York, NY 10017. 

18. title of Test: TOLERANCE FOR BUREAUCRATIC STRUCTURE SCALE (TBS) 

Description: Questionnaire intended to measure extent to vvhich an individual has a preference 
/for jobs typical of large bureaucratic organizations (i.e., highly structured jobs) 

* . ^ Format: The Tolerance for Bureaucratic Structure Scale was developed as part of a study 

designed to creaje conceptual and operational tooJs for achieving a rrfbre accurate match of 
persons jtojelsr?; The TBS Scale is a self-report questionnaire with 43 iteflris written in simple 
EngfisFiTSample items are, "I would like to have a job where I could set the hours" or "If 
s everybody obeyed the rules at work, there would be^fewer accident^." Each iterp is rated on.j 
a four-point scale (strongly disagree-strongly^gree). , v < \^ " *\, * 

Stage of Development: In some preliminary validity studies, significant, although mqdest, 
correlations were obtained between bank employees' TBS scores and ratings by supervisors. 
Some further validity data from employment and training applications of the TBS Scale are 
contained in a test manual available from the instrument publisher. This manual also provides 
information on test administration) and normative and reliability data. General background on 
the TBS Scale and the concepts underlying it are contained in related studies. ^ 

« Application: In its present stage of development, the Tolerance for Bureaucratic Structure 

Scale is probably not ready for operational use in employment and training settings but 
" could serve as a valuable source of ideas or could be used as a counseling tool, especially with 
respect to job opportunities requiring a'person to adjust tb a high degree of structure and 
bureaucratic regulation. 

„ Access: Available from the Center for 'Policy Research, 475 Riverside Drive, New York, 
NY 10027. 
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19: Title of Test:. TSENG RATING SCALES 

w 

Description: Short scales for mea§uring self-perception, locus of control, and need for 
- achievement • « * 

A Format: The Tseng Rating Scales were developed in three related studies designed to investi- 
gate relationships between work-related characteristics of vocational rehabilitation trainees 
and personality variables. Locus^of control was measured in Tseng using the Rotter Internality- 
Cxternality'Scale; need for achievement was measured in another study by Tseng by the 
achievement scale of the EdvVards Personal Preference Schedule, and self-perception J?y a 
rating scale devised by the investigator/ : ] v 
» » 

Stage of development: Each of these studies related scores on the test instrument used to # 
variables such as job proficiency, employability and training satisfaction of rehabilitation clients. 
Some efforts*Vvere made to adjust fallow reading levels or lack of test experience by participat- 
ing research subjects (e.g., vta individualized testing sessions), byt the researcher acknowledges 
that these measures have relatively little to recommend them for use with serioijsly disadvan- 
tage^ individuals. Correlations between test scores and perfqrmamce, criteria are guite modest. p 

* Application: Both because of limitations in use of these instruments with the severely dfsad- 
vantaged, and because the results obtained by Tseng are quite modest, these scales probably can 
serve only as a source of ideas for application^ employment and training settings. 

~ Access: Available from M.S. Tseng at West Virginia University, Morcjantown, WV 26507 

■ft 

20. Title of Pretesting Orientation Materiafr USES PRETESTING ORTEA/TATION, EXERCISES 

Description:' Miniature test battery for use in pretesting orientation • , * 

Forrfiat: The^exercises are administered as a series of short tests w^ose items resemble the 
first eight parts of the GATB. Administration time requires about one and one-half hours. The 
exercises offer practice in test taking to individuals who possess minimum literacy skills for b 
taking the GATB but who may have little'experience with aptitude tests and may be uneasy 
iboufbeing tested. Their use in pretesting orientation sessions will provide disadvantaged 
, applicants scheduled to take the GATB with experience in group test taking in a nonthreaten- 
ing atmosphere. Th§ exercises are flexible enough that they *can be shortened for individuals 
•who need only a refresher orientation to tests, or they cap b,e presented in full. 

' <*» ; > v *t 

Stage of Development: These materials were.developed by USES for specific use with the 
GATB snd have been applied in many employment and'training settings? 

Application: Although most useful for those agencies that administer the GATB as part Qf ' 
their assessment battery, the exercises could be usefully employed as pajt of a more general , 
pretesting orientation exercise. 

Accessr Division of Testing, Employment and Training Administration, U.S. Department of 
4 ' Labor, Washington, DC 20213, or through state Employment Service offices'* - 

Note:, The U.S. Employment Service has two booklets available (In bothSpanish and English) for self- 
ocientation-Do//Jfif Your Best on Aptitude Tests and Doing Your Best on Reading and Arithmetic, Tests. 
A "pretesting orientation on the purpose of testing" training course also is available^onsisting of an illus- 
trated lecture discussion with pictures and a prepared script. 
' " * ■ '« 
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Title of Test: VOCATIONAL 0?ltflON INDEX* (VOI) 

Description: Short paper-and-pencij instrument used to measure job readiness 

Format: The VCJl consists of 58 items which can be answered in about 20 minutes. It can be 
administered either in group settings or individually. Anyone who can read English or Spanish 
at the fifth-grade level should be able to respond meaningfully to all the questions. There are 
two forms of the VOI available in both English and Spanish. There are also forms which can be 

used for follow : up once the person has left a training program. ^- 

• • 

Because of the cqmplex^omputer'scdPing required by the VOI, Associates for Research 
in Behavior, the test publisher, has established a scoring service^jGOmpleted VOIs mailed to 
Associates for Research in'Behavior will be scpred and a diamrosis report will be mailed back 
within 10 days. Ea^h Vesponderft's-answers are added* to the/data base so that diagnoses pro- 
vided use the most-up-to-date data available. . * ^ 

\ . * * ' 

Stage of Development: The VOI is the product of a series of f *research studies conducted by 
the Associates for Research in Behavior. - " ' . 

The VOI determines an individual's job readiness by assessing three psychological dimen- 
sions: ' • „ * ' 

• ft 

* • Attractions to work r*"^ ^ * - 1 v • A 

• Losses associated with obtaining and maintaining a job . \ 

• * 

• Barriers to employment 

For those individuals who §core low on job readiness, the VOI also provides a diagnosis 
of reasons Contributing to the individual's classification as a potential nonworker. This diagnosis 
carr be used to develop a remedial prescription to help an individual develop a more work- 
relevgnj posture and attitude. 

The VOI was designed, tested, and normed specifically for a disadvantaged population. 
Norms are based on the responses of over 2,000 males and females from 13 MDTA centers 
, across the country. The normative sample was comparable to the national MDTA population 
with respect to age, sex, race/culture, and education. 

Application: Although the validity data on the VOI are stitl quite modest, it may have some • 
operational utility in certain emplpyment aqd training settings. 

• ** 

Access: Available from the Associates for Research in Behavior, Inc., 34th & Market Streets, 
Philadelphia, PA 19104 

Title of Test: WORK RELEVANT ATTITUDES^NVENTORY (WRAI) • 

Description: Instrument for use in evaluatihg the effectiveness of employment and training ■ • 
programs ■ \ 

Format: The WRAI grew out of a larger research program concerned with the effectiveness tarf 
selected Neighborhood Youth Corps (NYC) programs. The test consists of 26 items arranged \ 
into three scales:. optimism, self-confidence, and unsofciatj^ed attitudes. 

-j 
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Stage of Development: Th? author reports the use of th£ WRfAl in two longitudinal studies: 
(a) a Study of out of-school Neighborhood Youth Corps programs in four cities involving 502 
subjects and in which the WRAI was administered three times; and (bf a stud^f the second 
demonstration of a New Educational Program in five employment and training programs 
involving 526 subjects. Results indicate that the WRAI was able to differentiate between 
subjects making a "good" and a "poor" adjustment to work, that the change in WRAI scores x 
while participating in the NYC program was i.n a positive direction for subjects making a "good" 
adjustment to work, and negative for subjects making a "poor" adjustment. Further informa- 
tion on reliability and validity is available in Walther. The author feels that the WRAI can be 
used both as a measured program effectiveness in manpower service delivery systems and as a 
hejp in diagnosing the-needs bf new program participants. 

Application: Sufficient reliability and validity evidence is available to permit consideration of 
.the WRAI for use as a diagnostic tool as well as an assist Xq counseling. 

Acce$$:\ Th'e^eport is available from the author, Dr. Regis Walther, at George Washington Uni- 
versity, Washington, DC 20052. . ■ ^> -_v 

(NOTE: The two Backer volumes can be ordered directly from the EfllC Clearinghouse on 
Tests, Measurements, and Evaluation at the Education Testing Service in Princeton, New Jersey 
for $4.00 for each volume or $7.00 for -both volumes.) ? 
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SECTION B 

EXPLORING THE RESOURCES FROM 
THE MATERIALS DEVELOPMENT CENTER 
OF THE UNIVERSITY OF WISCONSIN-STOUT 



IN 



Anotfcer excellent resource is the Materials Development Center at the University of Wisconsin- 
Stout, Menomonie, Wisconsin. The following items are drawn from three of the Center's publications. 
For anyone involved particularly with testing of the physically disabled, the following sources should 
be explored in depth: 

, - • Psychological Testing in Vocational Evaluation by Botterbusch (1978) 

• The Use of Psychological Tests With Individuals Who Are Severely Disabled 
by Botterbuscfv(1976) % 

4 

• Client Rating Instruments For Use in Vocational Rehabilitation Agencies * ' 
edited by Esser (1975) 

The following tests are just a few Qf the many described in these publications. In addition, achieve- 
ment batteries,. reading tests/character and personality instruments, intelligence tests, and vocational- 
specific instruments are described. * 

23. Title of Test: ' CRAWFORD SMALL PARTS DEXTERITY TEST 

Description: This individually administered apparatus test takes about 15 minutes to complete. 
A work table and chair are required. " # " 

Fdr&at: A board containing 42 holes each on the left and right bottom portions and three bins 
for pins, collars, and screwfracross the top portiorl is used. Part I requires the examinee to use 
tweezers to pick up one pin and place it in a hole on the board. He. or she next uses the tweezers 
to fit a collar over each pin. After five pins and collars are assembled for practice, the examinee 
completes 36 pins and collars. In Part II the examinee uses a small screwdriver to screw 30 screws 
through a plate. Five screws ar"e used for practice. The amount of time required to complete 
Parts 1 and 1 1 is recorded for each-pfei*^The two time scores are compared to the appropriate . 
norm tables. * • 

Stage of Development: Norm Groups— Percentile norms based on thetime to completion are 
available on the following mate groups:* unselected applicarjts^jppliance factory applicants, two 
-veterans groups, and two high school groups. Female norm groups are assembly job applicants, 
factor\^pplicants, hourly employees, and employed assemblers. Alfsample sizes are at least 
100 anff most are ovdr 175. Sampfes are inadequately described. Reliability— Split-half reliabilities 
for Parts I and II are reported a's being between .80 and .95. However, since the Spearmart-Brown 
formula was used, these are overestimates. No test-retest correlations are provided— these would 
havefceen a more appropriate measure of reliability. Validity— The gianual contains summaries of 
several validation studies using wages and supervisors' ratings a£ criteria. Itie test also is related 
to other, dexterity measures. 

Application: Because no reading is required, this test may be used with persons who are illiterate. 
Upper extremity handicaps could prevent the successful use^ot this test. The Crawford appears" 
most useful in assessing persons for jobs involving the use of small tools^ncf rapid, repeated 
movements. ^ * * # f 
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Access: The Psychological Corporation, 757 Third Avenue, New York, NY 10017 

24. Title of Test: EDWARDS PERSONNEL PREFERENCE SCHEDULE (EPPS) 

Description: The schedule was.designed as an instrument for research and counseling purposes, 
to provide quick and convenient measures of a number of relatively independent normal 
personality variables. Percentile scores are given for 15 personality variables: achievement, 
deference, order, exhibition, autonomy, affiliation, intraception* succorance, dominance, abase- 
ment, nurturance, change^hdurance, heterosexuality, and aggression. 

Format: The schedule consists of 255 items each having two short statements. The person 
selects the statement that best describes him or her. Items have been carefully selected to 
minimize the influence of social desirability. A separate answer sheet is used. This untimed 
group or individually administered test takes between 40 and 55 minutes to complete. 

Stage of Development: Norm Groups-The EPPS was normed on the following groups: (1 ) 760 
male college students, (2) 749 female college students, (3) 4,031 adult males, and (4) 4,932 
adult females. The sample characteristics and sampling plan for these groups are not dearly 
defined. Reliability— The manual reports split-half and test-retest reliabilities for each scale. 
Split-half reliabilities range from .60 to .87; test-retest from .74 to .86. Considering the small 
number of items in each scale, these reliabilities are quite acceptable. Validity— The manual 
reports little validity data, except for a few correlations with other perspnality tests/lt should 
be mentioned that the EPPS has been-used in a wide variety of research studies and that the 
author of the EPPS has not revised his manual to include this new material. 

Application: The EPPS was developed for college students and adults; therefore, it has a fairly 
high reading level. The instrument is designed for normal persons and is not appropriate for use 
with Severely disturbed clients. A fair amount of test sophistication is necessary to use the 
separate answer sheet. • 

> ■ 

Access: The Psychological Corporation, 757 Third Avenue, New York, NY 10017 « 

'. ( . 

25. Title.pfTest: GENERAL CLERICAL TEST (GCT)' 

Description: A group administered pencil-and-paper test designed to measure aptitudes which 
1 % are of importance in clerical work of all kinds . 

Format': There are a total of fen subtests; all are highly speeded. The reviewer estimates total 

* administration time to be from 50 to 55 minutes. The testes published in two fqrmats: a 1 2-page 
booklet and two 6-page booklets. The GCT contains ten subtests: (1 ) checking-comparing 

* names, addresses, and amounts and picking out the differences- 19 items; (2) alphabetizing- 
recording th^number of a file drawer for names-61 items; (3) arithmetic computation-20 
items; (4) error location-using additioaand subtraction to find the error in a matrix-20 items; 
(5) arithmetic reasoning-reading problems-16 problems; (6) spelling-finding and correctly 
spellingyvords-29 items; (7) reading comprehension-answering questions about two paragraphs 
14 itemsr(8) vocabulary-selecting the word that means thfi^ame-40 items; and (9) grammar- 
finding and correcting the error in a seritence-24 items. /VII scoring is done by hand with a 
folded answer sheet. , ^ 
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of Development: Norm Grouqs^Norms are available on female students inJiigh schools 
and private business schools, for numerous*applicant groups, and several groups of persons 

* employed in clerical positions. Most fco/m groups are of adequate size witIT most of,the>norms 
developed in the late 1960s and early 1970s? Th*^ group characteristics are not described'as 
thoroughly as they should be. ReliabiJity-The results of two test-retest studies.are given in the 

. manual; the average correlation is in tlie low .90s. Standard error of measurement rejults^lso 
are given. Both sets of statistics imply that the GCT has adequate reliability-f or its intended use. 
Validity—The manual contains two types 6f validity evidence. First are correlations between.' m 
test results and school grades and grade point averages. These have" yielded significant results,^ , 
^Se cond are studies in which theGCT was correlatectjwith job success criteria (usually supervisory 
. ^fctings). The results of these are mjxed, Xhe test appears to have some degree of validity. 

Application: The purpose of the GCT is to predict employment or training success. The test 
can be used in a vocational evaluation .situation to assess an overall ability for clerical work* 
Obviously, to successfully take this test, the client neids good visual acuity, use of at least one 
hand, and an estimated sixth grade reading level. The major use of the GCT would be to provide 
an overall assessment of the client prior to in-depth assessment ror specific clerical jobs. 

• „ Access: The Psychological Corporation, 757 Third Avenue, New York, NY 10017 

^ - ■ ; ■ 

26. Titleof Test: HAN.D-TOOL DEXTERITY TEST ^ 

Description: The purpose is to ''provide a pleasure of proficiency in using ordinary mechanics' 
hand-tools. . . . The ability'measured by this ttfsf is a combinatfon.of aptitude and of achieve- 
ment based on past experience in handling tools." This individually administered apparatus 
N test is untimed;. roost examinees complete it in between five and.20 minutes. The apparatus 
frame should be bolted to a sturdy work table 34 inches high. The examinee stands during this 
test. 

U * * • 

format: Three different sizes (four &ch) of nuts, bolts, and washers are removed from one 
side of a hardwood frame with the aid of three wrenches and one screwdriver. The nuts and* 
^ bolts are then fastened and tightened through the holes or) the other side of the frame. The test 
administrator first reads the instructions and then times the examinee with a stopwatch. One 
tintoe score in minutes and seconds to completion is obtained and this is* compared with norm 
tables. Comparison with norm tables takes less than one minute. « 

Stage of t Development: Norm Groups-Percentile norms based on the tirti£ to completion are 
given in the manual for the following groups: malejob applicants in a southern plant, -male 
adults at a vocational guidance center t airline engine mechanics, apprentice welders in a steel •* 
company, electricafemaintenarjce workers, employees and applicants in a manufacturing com- 
pany, boys at a vocational high school; ancftfigh school dropouts in a metropolitan center. 
The composition of the ei gh t norm groups is not adequately described in the manual. The mean 
age, job experience, minfaity group status, and other important descriptive information is riot 
presented. Also the norms,fop four of th^ eight groups are based on sample sizes of less than 200 
subjects; these should be usectwith'extreme caution. Reliability— T+ie manual reports two test- 
retest studies which produced reliability coefficients of .91 and .81, considered moderately high 
for a performance test. Validity— Two types of validity data are presented: (1 ^correlations with 
foremen's ratings and (2) correlations with^other tests. Foremen's ratings were between .14 and 

• .51; other tests between .11 and .42. . * * * . 
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Application: Because no reading ability is required and because the manual permits the adminis- ■ 
trator "to supplement the directions in any reasonable way to improve the examinee's under- 
standing of the task," literacy and difficulty in understanding instructions should not be problems. 
The test does require full use of hands and arms and, therefore, may not be appropriate for people 
with an upper-extremity handicap. The "face" validity of the test may appeal to the disadvantaged 

and clients with low motivational levels. 

£ 

Access: The Psychological Coloration, 757 Third Avenue, New York, NY 10017 

27. Title of Test: ^KUDER OCCUPATIONAL INTEREST SURVEY (KOIS) 

Description: An untimed pencil-and-paper instrument which can be used with high school and 
college students as well as. with adults in employment counseling and retraining. 

Format: This instrument is group administered in approximately 30 to 40 minutes. The items 
are printed on the answer sheet; ng separate test booklet is required. The 100 triad items each 
contain three short statements of different activities. The examinee chooses the one activity in 
each triad he or she prefers most and the one activity in each triad he or she likes least. The 
KOIS must be machine scored. Each exa.minee receives a profile sheet plotting his or her results. 

Stage of Development: Norm Groups-Each scale was developed on a separate group of 
employed workers or students. The scales for all pccupational groups were developed on _ 
" * workers employed in these occupations. Students majoring in specific academic areas provided 
the data for the college major scales. All groups are clearly described in the manual. Reliability— 
Test-retest reliabilities over a two-week period are reported as .93 and .96. T he reliability was 
also defined in terms of consistency of the differences between scores or each pair of scales. These 
are at accepfable levels. Validity— The manual presents no evidence that jthe KOIS can predict 
future job success based on interest. However, data on classification of presently employed 
workers according to their interests are presented. 

* * 
• Application: The KOIS prbvides-information that aids in making a vocational choice or 

selecting tentative field of study by identifying interests in relation to occupations or occu- m 
pational fields. Because the KOIScovers a wide variety of occupations,. and combines male and 
•female occupational interests, it has a wide variety of uses within the evaluation setting. Persons 
must be able to read at the sixth grade level to use the KOIS. Because of the^ize of the print 
and the lack of contrast between print anc^paper colors, persons with evenTnild visual problems 
may have difficulty reading the Items. There are scales for many occupations that do ntft Inquire 
college or technical training, thus making the KOIS useful for persons wfio do not desire addi- 
* tional formal education. However, the college major scales make it most_appropriate for high 
school students and others who are consideringformal academic training. 

Af^ess: Science Research Associates, Inc., 155 North Wacker Drive, ChicacjB, I L 60606 ^ 

28. Title of Test: 'SAN FRANCISCO'VOCA^TIONAL COMPETENCY SCALE 

Description: The scale was developed for the purpose of assessing .the "vocational competence" 
,of mentally retarded persons participating in sheltered workshop and vocational training 
programs. 9 s ,,. s — * 
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Format: The scale consists of thirty items relating to four areas of vocational competenqe. 
These four areas include motor skills, cognition, responsibility, and social-emotional behavior. 
The items are not organized according to these four areas on the scale, but are said to be 
\Dositioned according to the sequence in which the behavior would occur during task perform? 
ah^ by the individual. Each item is rated according to one of four or five statements or terms. 
Some items have four statements which apply and others have five. These statements or terms 
have a numerical value ranging from one for thsJowest level of competence to four or five 
representing the higjjpShdegree of competence. 

Stage of Development: Items cQntained in the scale were selected on the basis of factor 
i analysis. The final scale composition is the result of two pretests. The nerm group rs made up 
of 562 mentally retarded maid and female workshop clients, representing forty-five workshops 
from all region's of the country. Internal consisfef&cy reliability efficients are reported as .95 
for both male and female subjects. A test-retest stability coefficient of *85 resulted from two 
administrations of the instrument separated by a one-month interval. Vocational competency 
scores were found to have statistically significant positive correlation with I. Q. scores and 
school experience. A more detailed diseossion of statistical procedures is found in the scale 
manual. ■ ✓ 

Application: The authors suggest five more specific uses for the scale, including: selection of 
mentally retarded individuals for training in semi-independent or sheltered situations, assess- 
ment of an individual's status at a particular time, judgment of growth in vocational competence 
over a period of time, study of the relative efficacy of different training methods, and screening 
of mentally retarded individuals for placement in independent work situations/ 

Access: 'The Psychological Corporation, 757 Third Avenue, New York, NY 10017 - ^ 

29. Title of Test: SRA MECHANICAL APTITUDES 

- Description: >This group-admirristered multiple-choice, pencil-and-paper test car> be giveri in 
abouj 40 minutes. It is intended to measure three aspects of mechanical ability. The concept 
behind the SRA Mechanical Aptitudes js that "no single test consisting of iterr^which measure ' 
only one'primary component of mechanical aptitude can provide a satisfactoi'Pfcdex of the 
ability to learn mechanical skills." . - 4 

* 4 

Format: The test contains three sections: (1) mechanical- knowledge-45 pictures of commonly 
used tools and implements are identified and/or their use is gi\/en, .(2) space relations-40 
figures cut into two or three pieces which are mentally termed into a whole, and (3) shop 
arithmetic-124 problems, most of which are based on drawings. The manual contains no 
estimated reading level, but the reviewer estimates that a fifth-grade level is needed. The test * . > 
is hand-scored using a carbon-centered answer sheet. Raw scores are compared to norms and* 
plotted on a separate profile sheet. Scoring time should be less than three minutes. 

✓ 

Stage of Development: Norm Groups-Separate norms §re given by sex and grade for grades 9 
through 12. Norms also are given on 650 mdle trainees. Althbugh all norm groups are of 
adequate size, the sample characteristics are nordescrjbed in enough defail to permit an accurate 
judgment of their relevahce. Reliability-Internal consistency estimates using the KR-21 formula 
are given for the school boys groups on each score. They range from .55 to .83, which are 
acceptable. Validity-No validity data are contained in the manual. 
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Application: The test is designed to assess the mechanical ability of persfons planning careers 
or applying for jobs in mechanical areas. ^ * 

.Access: Science Research Associates, Inc., 155 North Wacker Drive, Chicago, I L 60606 

30. Title of Test; WORK BEHAVIOR RATING SCALE 

'Description: The sc^)e was designed*for use with the mentally retarded*. The scale is actually 
- one of four sections used in comnleting the Trainee Evaluation Report. 

. (format: The scale is a graphis/«rtihg device consisting of thirteen items. The scale items are 1 
labeled as follows: co-workers relations, disruptiveness, tolerance for criticism, independence 
from supervision, cooperation with supervisor, understanding oral instructions, memory for 
instructions, motivation for vyork, concentration ability, punctuality, quality of Work, quantity 
of wojk, and safety awareness and habits. Definitions or cues are provided for each scale item. 
In addition, poinjs alpng the continuum for each item also are defined or cued. Letter and 
numerical values arp assigned to points along the item continuum. The numerical values are 
provided for making finer discriminations oian individual's relative position between points 
along the continuum. 

Stage of Development: A reliability coefficient of .80 for the total scale resulted from the 
comparison of ratings for two independent raters who evaluated the same group of trainees. 
Reliabilities for individual scale items varied considerably. 

Application: As indicated, the scale is intended for use with the mentally retarded. 

Access: , Exceptional Children's Fpundation, 2225 West Adams Boulevard, Los Angelas, -CA 

90018 _ Sm 

< r 

31. Title of Test: WORK ENVIRONMENT PREFERENCE SCHEDULE (WEPS) 

Description: The WEPS is a self-administering pencil-and-paper test designed to measure a 
personality construct, 'bureaucratic orientation,' which reflects a commitment to the set of 
attitudes, values, and behaviors that are characteristically fostered and rewarded by bureau- 
cratic organizations. The title of the test is somewhat misleading-the WEPS measures only 
the personality construct of accepting work in a bureaucracy. 

Format: Although not specifically stated in the manual, the test can be administered to 
* individuals or^groups in a maximum time of 10 minutes (the WEPS is untimed). The 24 items 
consist of Statements which the examinee responds to by use of a five-choice Likert Scale 
(strongly*5gree, agree, undecidfed, disagree, and strongly disagree). The WEPS is scored by hand 
and no stencil is needed. The test administrator sample totals the weights assigned to each 
alternative and reoords its raw score number. A percentile score is given; there are several norm 
" groups. 

Stage of Development: tM^TGroups-The WEPS has norms on a variety of student and worker 
grQups of both sexes^sor^Bf these-are: male andfemale'high school and college students, Army 
ROTC, foremen, salesmeflBntal hospital employees, arid three types of public school adminis- 
trators'. The sample sizes appear, adequate, but the samples are not described in enough detail for 
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the reviewer to judge their representativeness. Reliability-Two types of reliability data are 
reported in the manual: (1) internal consistency measures oh four groups are .83, x 84, .89, and 
.91 and (2) test-retest reliability studies review a correlation of .82 for a short time period and 
.65 after 16 months. For an instrument with only*24 items, these coefficients are-acceptable. 
Validity-The manual presents considerable validity data in the form of correlations with scales 
on other personality tests as well as attitude scales on authoritarianism, dogmatism, etc. Validity 
data based jx^peer ratings, performance ratings, and other criteria are given. Taken as a whole, 
the data presents the WEPS as being a valid instrument. . * 

Application: Because the sentence structure is fairly com£f£x and t)ie vocabulary level of the 
items is high, the user will have to read at a0but the tenth-gra.de level. The instrument could be 
used for clients who are considering jobs in organisations having a bureaucratic outlook. It could 
also be used as a vocationally oriented- measure of a person's attitudes toward authority. ^ 

Access: The Psychofogical Corporation, 757 Third Avenue, New York, NY 10017 
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SECTION C 



EXPLORING SUPPLEMENTARY DATA 



This section reviews a number of additional paper-and-pencil tesis-and assorted instruments- 
that could serve as testing resources. Some, such as the Job Career Skills Assessment Program, are 
fairly new. The majority may b§ suitable for use with diverse groups— both disadvantaged and non- 
disadvarrtaged. This listing was compiled by staff at the National Center for Research in Vocational 
Education. The reader is reminded, however, that many more resources are available, particularly 
In the two volumes edited by Buros: Tests in Print II and The Eighth Mental Measurements Yearbook. 



32. Title of T^st: ADULT PERFORMANCE LEVEL PROGRAM: ADULT AND HIGH 
SCHOOL SURVEYS 

Description: The adult survey is designed to diagnose and evaluate competencies necessary for 
adult living; focuses on those skills critical for functioning in society in the content areas of 
community resources, occupational knowledge, consumer economics, health, and government 
law. The high school survey is designed' to diagnose and evaluate coping*skills and knowledge 
necessary to functional competency; it also focused on application of basic skills in the content 
areas listed above. , * * * • 

> * 

Format: The APL Jadult survey) is a curriculum-related assessment program that encompasses 
the five general content areas noted above. At the same time, the test, a 40-item instrument, 
focuses on five specific skills; identification of facts and terms, reading, writing, computation, 
and problem solving. Each skill is tested within each content area. The reading level, of the survey 
items is between fifth and sixth grade as measured by the Dale-Chall readability analysis. The 
test takes approximately 1% hours to administer. 

The format for the high school survey, also 40 items; is multiple choice. Each item measures 
a basic skill applied to a practical task in one to five content areas. The high school form is at 
the fourth and fifth grade reading levels. The test is not timed but takes approximately one hour 
to administer. No special training is needed to administer it. The test is either hand-scored or 
„ machine-scored. 

, • * 

Stage of Development: Versions of each survey form were administered to representative 
populations iri 1976. Therefore, it is the only available test of functipnal competency that has 
been administered to adults and high school students throughout the country. Both reliability 
. and validity data are cited in the test manuals. g L ^ 

Application* The publisher indicated that the test can bexta^d "as a screen for student profi- 
ciencies and deficiencies" arjd to certify that students have acquired basic functional skills 
before graduation. „ , 



Access: The ACT Program (APL Department), P.O.. Box 168* Iowa City, I A 5224jD^ 
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33. Title of Test: APTITUDE J^STS FOR OCCUPATIONS 

Description: The tests are designed to aid in vocational coun^ 
\occupatjpnally related aptitudes and potentialities. 

* ■> * • * 

> \format: The battery includes tests for: personal-social aptitu^ 
sales altitude, clerical routine aptitude, computational aptituc 



ling through the assessment of 



Stege of Development: 



Reliability and validity data are proty 



le, mechanical aptitude, general 
and scientific aptitude. 

Jed in the manual. 6 



Application: W$\s battery might be given in conjunction witma standardized interest inventory. 

This will provide a counselor with asource of information concerning both interests and 

aptitudes. « — t 
» 

Access: (fTB/McGrawJftl/Del Monte Research Park, Monterey, CA 9394D 



34. > Trtleof\es\: BENNETfyhECHANICAL COMPREHENSION TEST 

x : 

Description:' This sensorv-mechamcal test measures the ability to perceive and understandjhe 
relationship of physical fo<fces artd rrtpchanical element's. k * 

- r" if > > % ° 

Format: The test consists of two Torrrts, S and T; each consists of 6B items. Each item includes 

a pictmkfixhibiting one or more objects, physical situations, or mechanical relationships about 

• which a question is asked. The prittQiples' # undej;lying these questions include leverage, force and , 

motion, light, heat, and sound*. Th^Sxarnples used are onesWising out of peo^e's common 

* * experiences rather thap from technical training*. ^ * 

* * * t ^ ' - • " 
The forms are suitable for male and female applicants for industrial and mechanical jobs, 

and for high school students, for people already employe^) in mepbanical jobs, for candidates 

for engineering schools, and for other adult groups of comparable abilityand education. Each 

form is printed in a reusable booklet. The answers are marked oriAseparate answer sheet. Forms 

S and T are timed tests with a 30-minute limit. The score is basedSlrthe/iumtfer of right answers 

. . with no penalty for incorrect responses. Both tests are hand-scored, using special scoring keys?* 

Stage' of Development: Norms are available for both men and women. A Spanish edition is 
available. There is no mention of Blacks or disadvantaged. , 

. ;* ■ • ■ * . , 

Application: The test is for use by counselor*, in conjunction with other assessment tools. The 
.tests may be most useful^wben used with clerical aptitude sand manual dexterity tests to predict 
current performance in selected mechanically oriented occupations.. - 

Access: The Psychological' Corporation, 757 Third Avenue, New York, NY^1001 7- * 

* 'V m * # 

35. Title of Test: CALIFORNIA OCCUPA TIONAL PREFERENCE SUfiVEy (COPS) % , 

Description: *An interest inventory that ftavides* job activity/interest scores relating to occupa- 
tional clusters.*£ach cluster is keyed to a curriculum choice and a 'major source of jdb informa- 
tion including the Dictionary of Occupational Titles and the Occupational Outlook Handbook. ,„ 
It i$ appropriate tor grade B through adult and comes in a Spanish language ec^tion. . m 
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Format: The inventory co/isists dt^m items describing activities performed in a variety of 
occupations. Jest takers respond onl^jjp^int scale indicating how much theyjike each 
activity. Fourteen occupational cluster sclS^re obtafned, inciting; science-professional; 
'science-skilled; technfcal— professional; technical— skilled; outdoor; business-professional; 
business-skilled; clerical linguistics— professional; linguistics— skilled; aesthetic— professional; 
service-professional; service— skilled. COPS.comes in a single, self-contained booklet and takes^' 
abftut tyrenty mmutes to admi nister. )t can be , self-scored in about that same time; hence, thef&? » 
is imipediate feedback. It is written at a sixth i^rade'read ingle vel. There are~two other related 
instruments: the 'Career Ability Placement survey of abilities, yvhich includes tests of mechanical " 
reasoning, spatiaj relations, verba) reasoning, numericaLability/ language usage, work knowledge,, 
.perceptual speed and accuracy, and manual spe^ct^nd dexterity; and the Career OrjentJtion 
Placement instrument relating to such things as work values/leadership abilities, and orderliness. 

Stage of Development: The instrument was developed from research into the structure of occu- 
pations. The research was base'd on tffe classification of occupations into major groups and levels 
with the groups. National nornsiing is provided to compare the responses against a single norm 
' sample; the data is forgrades 7 through >2.\The information on validity is weak and somewhat % 
vague. . * ^ * - 

• Application; The instrument can be used by a counselor with the vocationally as well as the , 
' college oriented. The results show the student's relative.standing in each occupational cluster as 
compared with other students. Scores cafi be used in business and indusjrial settings for employee 
self-awareness. * I • , 

* ■ * *' - 

Access: Educational and Industrial Testihg Service, P.O. Box 7234, San Diego, CA 92107 

36. Title of Test: CAR EES SK/LLS\^$$ESSMENTPROGRAM (CSAP) 

Description: The Career Skills Assessment Program consists of six separate spl'f-assesjmerrt areas: 

• Self.-Evaluatiori and Development Skills * ■ • 

• Career Awafeness Skills 0 r \ 

• Career Decision-Making Skill's ~ 
, • Employment-Seeking Skills 1 ' ' 

* • Work Effectiveness Skills ^ ' f 

4 : .• Personaf Economics Skills • r 

The measures are designed to assess instructional^ relevant cjtisters of skills and mjiy be used 
alone or sequentially. . . ' 



" — ^"^"^ ; — : — ; — r =^ ' r - — 

Format: Materials f on each urea include:; umm \ * * ' mJ \ 

Exercise Booklet.,— Ccftifains 60 (9rultiple choice questions; reusable. < 

^^^^•^espome^beet^TJarffjeipiy, icnRfLPer[Dits students to self-score wrth immediate feed- 
. » back and enables teachers to measurfcl;lass performance without a timejag. One copy 

ray be sent for batch nrjaehine scoring to generate summary reports*of group performance 
" for use in planning ot.evaluatibn.i „ „ . ; v 

• Self-Instructional Guide - A self-guidan9e unit organized around.eadh of the six target y 
skill clusters. A personal 1 resource for the individual, with a section providing an explana- „ 



tion of the rationale for the preferred response to each question. 

• Supporting materials include detailed.direttions for administering the measures, a 
handbook for administrators, counselors, and teachers, and a sound filmstrip kit for 
staff and student onentation, 

s 

Stage of Development:. CSAP measures will not be standardized on ajiational [jDpulation, 
Because a national reference-group is of limited value in interpreting performance in the area of * 

• cafeer development. The most valuable and appropriate reference group-for understanding an' 
individual's career developments the group she oj- rie most resembles educationally and demo- 

-^graphically. Jhe reporting procedure/therefore, makes provision for the production of local 
, norm data. 4 . 

Application: The deJign.of the.program is such that it can be adapted to a variety of situations- 
as,homework assignments, as learniqg units in seminars, to complement activities in academic 
and vopattqnal classes. Counselors will find the materia]? effective in both individuafand group 
"guidance sessions, and teachers can work with the materials in the cla^sroofh. Them^sures also 

* are Appropriate for jnany adult education groups as.weH.as Work Incentive programs cjnd Com- 
prehensive Employment and Training Act programs. ' ' • . 4 • , J|t 

Access* .Career Sfcifis Assessment Program of the College Board, P^Of Box 2839, Princeton N3 
08541 ' % , * 



•37. VtlfofYest: DM LEY VOCAflO^^0$fS 
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EfescHption: VThese tests are designed to assess potential-aptitude and achievement— for training 
and succeWn a number of occupations within the trade, technical^ and busirress-secretaria^ 
fields. It ^designed to be used basically with persons who plan to enter occupations at the skilled 
level in these a^eas, f • 

Format: The two items can be used separately-or as a battery. They are the Technical/Scholastic ' 
Test and the Business English Jest. The Technical/Scholastic Test contains 150 multiple-choice 
.items fonmeasuring b&th current knowledge* and potential in electrical, mechanical, and scholastic 
areas. It contains thr* Scales including: (1) clerical scale, (2) mechanical scale, and (Scholastic 
scale. Th$ Business English Test consists of 111 iterm testing spelling, punctuation, capitalization, 
and grammar/The tests are appropriate for gr.ads 10 through adults. The Technical and Scholastic 
Test takes 65 mipute* and the Business English Test takes 3Ckminutes. The tests are both hand- 
scgred and machine-scored! ' 1 * * • • ■ - , 

i • ' 

'* k " * _\ 

Stage of Qevefapment: *The publisher indicates that norms -have been developed to be used for 
guiding students in.academicand vocational choices atthe junior and senior high school levels; 
for screening students in tradg^, technical, and business schools; and for selecting personnel" for 
certain jobs in business arid industry. . • - * . 4 

Application: The test is most applicable in business and industry and in specialty-oriented 
vocational schools/ ''. / mm 

Access: Riverside Publishing Company, 8420 Bryn Mawn Avenue, Chicago, IL 60631* * • 
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. 38. Titleof Test: DIFFERENTIAL APTITUDE TESTS (DAT) ' . ... 

Description: This DAT is an integrated battery of aptitude tests designed for educational and 
vpcational guidance. Based on the research finding that "intelligence" is not a single ability but 
rather a number of abilities possessed in varying amounts by each individual, the battery yields 
nine reliable scores including an index of scholastic ability. These form a basis for helping \ 
individuals develop educational and vocational plans. * ■ ^' 

- — Format: Thp HAT prnwidp V a prnfilp nf thp r^ U tivP strpngths and vyeaknesses of eac h StiidfiQt 
in eight,abilitiesf (1) verbal reasoning, (2) numerical ability, (3) abstract Reasoning, (4) space 
relations, (5) mechanical reasoning, (6) clerical speed and accuracy, (7) spelling, anti (8) language 
usa^e.'A ninth score,, an index of scholastic ability obtained by summing % the verbal reasoning 
and numerical ability scores, serves essentially the same purpose as scores derived from standard 
/intelligence tests. The testing populations ra^g^ 0171 grades 8 to 12, college-age persons,^nd 
( adults. The^otal hattery of eight tests takes twie hojurs to administer. Administration shoul.d 
be by a counselor. Thje test is hand-scored or machine-scored. 

Stage of Development: Validity scores present correlations of DAT scores with course grades 
in a variety of areas and with scores on a variety of achievement tests. Correlations witfi other 
standardized aptitude tests (e.g., the GATB), achievement measures, and interest gneasungs are 
i reported. Normative data, however, are not given regarding the relative representation of various 
ethnic or socioeconomic groups. Norms fo^males and females are available. 

Application: The-primary use has been in counseling individuals. The specific aptitudes with 
* which it deals are verbal reasoning, numerical ability, abstract reasoning, and clerical speed and 
accuracy. , ^ 

^ \ Access: The Psychological Qprporation, 757 Third Avenue, New York, NY* 1 001 7 

• 39. 'Title- of Test: FLANAGAN APTITUDE CLASSIFICATION TESTS ' , * 

Description: The tests are a comprehensive aptitude test battery of 16 separate aptitude tests 
* . which enables the tester to comt>ine scores on the skilj tests to measure potential for success in 
4 " specific careers. ' •* „ > * ** 

Format: The subtests include:' (1) inspection, (2) coding^) mer?iory,14) precision, (5)*, . . 
assembly; J6) scales,^(7) coordination, (8) judgment and comprehensipnVO) arithmetic, 
t (tO) patterns, (HLcomponents, f12) tables, (13) mechanics, (14) expression, (15) reasoning, 

vand (16) ingenuity. T/fe aptitude battery has the.advantage-of/elatirig aptftude patterns to 
) vocational areas/ However, considerate ski IJ and praptice are needed,tfc administer the tests. „ 
The'timefor the tests varies from 5 to 40 rrtinutes. A highly trained Administrator is needed 
^ dueOo thp Jpngth ancLrelative difficulty of administration.'- - , 
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Stage of Development: ,Test literature indicates thaHhe greatest weakness in the battery is * , 
*> its lack of validity data to Support many of the claims fpade in the manual *ar?d in accompany- 
♦ ing^iaterial^.The test" literature further indicates that until more! validity data ar,e avail^^e, if"' ' . 

would' probably t be best to be extremelyxautiOus in interpreting the meaning of the scores. 

Validitycoefficients for occupational standards with criteria of progress and performance in ^ 

business and clericalTields wer^low for secretary, typist, stena^nd sales clerks. r . • <, 

• . ;• . • • w * 

* • - ; -• * 89 ' • 
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Application: XWe tests have been designed for Vocational counseling and as a guide for planoing 
a suitable pr/xjram of sch^hcourses. 

» A, * 

Access: Sconce Research' Associates', Inc., 155 North Wacker Drive, Chicago, IL 60606 

Title of Test: HALL OCCUPATIONAL ORIENTATION INVENTORY 

Description: The inventory provides a systematic framework designed to enable the individual 
tcrexplore the fetors involved in occupational choice in terms of the relationship between 
psychological needs and value fulfillment, worker traits, and jpb content characteristics. 

Format: The scales of the inventory are as follows: (1) creativity-independence, (2) risk,, C3) 
knowledge-information, (4) belorigingness, (5) security, (6) aspiration, (7) esteem, (8) self- 
actualization, (9) personal satisfaction, (10.) routine-dependence, (VI) data orientation, (12) 
things orientation, 113) people orientation, (14) location concern, (15) aptitude eoncern, (16) 
monetary concern, (17) physical abilities concern, (18) environment concern, (19) coworker 
concern, (20) qualifications concern, (21) time concern, and (22) defensiveness. 

Controlled vocabulary and readability levels make ij appropriate to use with reading 
handicapped adults. The inyentory is untimed, but takes Approximately 30 to 40 minutes. 
Machine scoring is Available. The answer format is frefe choice, allowing every item to £>e 

answered through a five-point scale ranging from "essential" to "intolerable." 

& ' - 

Stage Of Development: Validity dat^areijiven for items and for scales, mainly in the form of 
discrimination between different age, educational, or sex groups. The scales that significantly 
differentiate between a number of occupational samples, with numbers varying between 40 and 
J 25/ are presented/iHowever, the norming information is vague and^skimpy; no^normsare 
presented for women. « * m0 \^ \ 

p . -* " _ 

Application: The inventory attempts to assess the relative importance to the person of a 

number of factors br attributes of work. Th\ focus is pn occupation behaviors rather than 

specific occupations. « A % • \ ^* 

^ , * < *V * I \ . " • . ~ * 

Access: Scholastic. Testing Service, Inc., 430 Meyer Road, Bensenville, IL 6010& 

Title of Test: HARRINGTON/O'SHEA 'SYSTEM FOR f CAREER DECISIONMAKING (CDM\ 




-Description: This instrument provides* a framework for.self-arralysis of six areas critical to 
career decisfon-maki'ng: occupational* choices, school subjects, future education or training 
i plans, job values clarification, abilities, and interests. . "\ * . . « ' 

Forrpat: The CDM helps4ndividtfals to pstahlish,caree'r awareness, finake careSKdecisioos, and 
acquire information about the kicids of jobs they might enjoy. It consists "of wee systems — 
depending on whether it is self-scorjed or computer-scored, computer ,or indiyflCfuafly interpreted, 
or a combination of the tVvo. A surye^booklet and interpretive form are provided for ^ach *• 
th^t^ree-s yst e ms. Al l thr ee-evaiuate-ibe-six c riti c al c areer decision-making areas noted! The 
CfDM can be group or self-administared. Small group administration (i.e., in a olassrpom) is 
pr^fenable to mass administration, smce-it is "not a test, individuals may communicate while 
completing it. The edministrationjtime is 30 to 40 minutes. • j - :." 



/ 
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Stage of Development: Reliability studies were reported for Setf-Scoring System S. Based pn 
re test and internal-consistency procedures, the reliability was .88 for jnales and .89 for females.. 
The normative group consisted of 2,256 males and 2,753 females. Whites, Blacks, Spanish 
Americans, and American Indians were represented in the group. 

•» * 

Application: The CDM assesses educational deficits and achievements in terms of career aware- 
ness and decision making. Curriculum could then be developed and the need for career counseling -a 
assessed. • - f . ^ 

Access: Distribute^ by Chronicle Guidance Publications, Moravia, NY 13118 . 



42. Title of Test: INDUSTRIAL READING &ESY (IRT) • . • ' •„ 

Description: A fairly new test of reading ability designed as a screening device with applicants ' 
or trainees for technical or vocational training programs, j n • 

Format: The I RT represents an alternative approach to the measurement of reading skills. It is 
specifically constructed so that the students, trainees, or applicants for whom the test is intended 
will find the material directly relpvantand "meaningful. Some of the rdfcdjng passages are repre- 
sentative of sections encountered in technical manuals; others are written in the form of a company 
memorandum. Good performance on' the test is not dependent orf previous knowledge of the 
subject. The test is appropriate for grades 9 to 12 and- adults." Hand-score answer keys and machine 
« - scoring are available through the publisher. Two forms are Available. Form A is restricted to use 
l by industry; Form {3 may be used by both schools and industry. The test takes 40 minutes. ^ • 

Stage of Development: Normative data, reliability, and criterion-referencec^validity have been 

established on the following groups: apprentices, technical trainees, vocational high school 

students, and adult students in vocational training programs.' 

• * * « * 

{ Application: Test results attempt to^show whether.or not an incMvidual hg^the necessary reading 
abHity to make satisfactory progress in technical training. Vocational schools may use the test to 
help students select an appropriate program. Schools and companies that provide remedial reading 

N instruction may use it to identify students, workers, or trainees who would bene'fit from such 

p> instruction; \ ' \ 

t 

* Access: Jhe Psychological Corporation, 757 Third Avenue., New York, NY 10017 

43. Title of Test: JOB ANAL YSIS AN& INTEREST MEASUREMENT (/AIM) * * 

Description: This self-description inventory -measures coping skills important to performance 
and satisfaction in work roles. It i$ designed to measure factors such as " getting, al on g" (cooing ) 
fc by determining the degree of match between requirements and potentials of jobs and the . 
individuals self-reported behavior styles, activity prefecence>^nd values. * 

Format: JAIM provides scores for 3?- specific scales; for example, self-confidence, orderliness, 
perseverance, assertiveness, dependability, emotional control, and the like, (trfoes not«have to ; 
be administered under test conditions; in fact, one can complete it at home and return it b/ 
maN. There is no time limit, but it takes3pproximately 30 to 40 minutes for the average white- 
col.lar worker to comptete.«There is no hand scoring; it is scored through a computer program. 
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Stage o7. Develop faehl' '"the instrument wps developed by studying the job and the individual 
jni relationshiRJo/eaish qther. Jobs were studied by analyzing behavior^ requirements and satis- 
factions and value potentials of the job an<4 th'eft -making inferences as to personaUcfiaracteristics 
c& the* workers who were,associated with job performance and satisfaction. Some preliminary 

* reliability and validity data are provided. 

Application: Potential uses include individual counseling (comparing oneself to scores of a 
norm group and scores of a wide range of occupations and professions), estimating job % require- 
ments and satisfaction potential of particular jobs or roles, and assessing personnel decisions. 

Access: JAIM hesearcn, Inc., 1808 Coll ingwooa hoad, Alexandria, VA 22308 ^ ~~ . * 

44. Title of Jest: JOB INTEREST AND LITERACY LEVEL EVALUATION INSTRUMENTS/ LLjt 

Description: JILL is a self-admintstered checklist which elicits perceptions of what the client 
wants to do, how he or she wants to do it, antf how well the client thinks he or she §an perform. 
The extent to which the client thi inks he can perform is the measure of "aptitude." The check- 
lists for interest and aptftude, therefore, are subjective measures. The instrument is in two parts. 
i The second part is a survey <af basic skills, i.e., a simple test of literacy. 

• * * 

Format: The JILL can be setf-administered or filled in by the counselor. It can be doneJn 
groups or individually. A counselor can read the instrument to the client and Fecord answers in 
about a half hour or less. A person with eighth grade reading skills can complete the two parts 
on his.or her own in 15-30 mjnujtes.Jhere are five main questions in relation to job interest 
and aptitude. The first deals with desired physical Aspects of potential jobs. The second and third 
, questions deal with nonphysical job aspects'and again are forced choice situations. In question 4, 

* the client is»asked what general kind of work he or she would like to do. In question 5, th^.clieht 
indicates his or her "aptitude" by considering to what extent, or how well, he or she can dp the 
spjscificduties. * \ . 

^There are nine questions in th*literacy level or basic skills survey. The first three corres- 
pond to' sixth.-grade level skills, the next three to eighth-grade levej skills, and the last three to 
twelfth-grade level skills. Questions 1, 4 and 7 involve the use of reading skills.^Questions 2, 5, % 
.Srid 8 involve the use pf writing skills. Questions 3, 6 and 9 are computation items'. The test 
ranges from easy to difficult. There is always the option of "I don't know." and client^ are 
encouraged to check this response rather than guess. • 

*" ***** * ** 

Stage of Development: The JILL was put togetherT^r use by CETA counselors in Texas. The 
instrument, which is owned by the University of Texas at Aostin, is in an experimental stage. 
As such, it is for'use with CETA clients ohly. Initially" permission to use the : jtest will-be reserved 
to "those operators who will agree to provide the kk\d of feedback information necessary for 
revision and.validatioh. The intent js not arbitrary; rather it is based on the determination to 
provide an instrument that offers the highest possible level of validity and reliability. 



Applicatidn: The JILL was developed* f^ruse in initiaf interview sessions. Based upon comments 
of GET A counselors, it was felt that if arVtestirfg a t all was" to occur, the most important infor- 
mation that could be of use to a counselor vyals data that g&uld aid in placing an individual appro- 
praately^The rationale was that if a person could be put in a situation that best fits him or her, 
then that persorvwouid be more likely to achieve, and some problems with client motivatjort 
could (?e avoided. The instrument, therefore, is a tool that enables the counselor to'be of greater 

* , ' 92 ■ /.' . 
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service to the individual than he or she would be otherwise. It is a way of recording data that, 
along with other information known about the client, aids the counselor in his or hex important 
• decision-Tnaking processes. % . 

IP ; 

Access: Adult Performance Level Project, The University of Texas at Austin, College of 
Education, Austin, TX 78712 K . " 

. 9 

45. Title of Test: KNOWLEDGE OF OCCUPATIONS TEST * • ° 

; s * 9 ' 



Description: The test has b^n constructed to measure the extent to which high'schpol students 

* have knowledge of occupations. » 

Format: For the purpose qf constructing this test, knowledge of occupations has been defined 
as information possessed by an individual regarding job descriptions, training, certification.and 
licensing, trends, tools, terminology, earnings, and t^e ability to interpret occupational material. 
The test consists of 96 questions grouped into the eight categories noted above. The test has a 
forty-minute time-limit and is eithenjtand- or machine-scored. • ^ s ^w-%- 

Stage* of Development: The .items were constructed after a detailed analysis of literature in 
the vocational field and of various career ma^terialVused in high schools. Since the test wa§, 
initially developed in 1974, parts of it may be outdated. The manual contains limited informa- 
tion on norm groups, validity, and reliability. 

Application: The |*imary function of the test is to provide information for the counselor and 
student. A high score on the test does not guarantee success in an occupation, nor does a low 
score guarantee faijjjre. However, 1he counselor should make certain that students scoring lo,w 
have accurate infonmation on whfch they are basing their career and vocational plans 

/ 5 P - * 

Accessf -Psychologists and r Educators, Inc., Jacksonville, I L 62650 . 

* m * * • • * 
46. {Title of Test: MINNESOTA IMPORTANCE QUESTIONNAIRE (MLQ)-- f t < 

description: The MIQ is a paper-and-pencil inventory of vocational neecfs: preferences for . 
occupational reinforcers. ' ' 

Format,: The questionnaire is designed to measure the fallowing '20 vocationally relevant need 
4 dimensions: Ability Utilization, Achievement, Activity, Advancement, Authority, Compwu* 
Policies and Practices, Compensation, Coworkers, Creativity, Independepce, Moral Values, 
Recognition, Responsibility, Security, Social Service, Social Status, Supervision-Human c * 
^ Relations, Supervision-Technical, Variety, and Working Conditions. 

^ T wo fo r m raHhr M I Q a r e available. The Paired 1 Form presents pairs bf vocationaLneecf " 

♦ "'statements; thfe individual indicates thfe more imfport&nt ne6d in each pair. The Ranked Form , 
presents'.vocaticfnal neecKstatements m groups of five, and the individual rank s the f ive needs in 
each group according to their importance. The vocational-need profiles obtained from the Paired 

* and Ranked Forms are 4 «highly simUrfr. * \ ' * 

Jftb MfQ can be Administered to groups or to individuals. Most people complete the " 
Paired Form in 30 to 40 minutes. Thq Ranked Form usually requires 15 to 25 minutes to 
complete. Instructions for tfieaelf-administrationfcf the MIQare given in the bookl^t.The « 
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^ ... 
MIQ booklet and answer sheet arfe designed for individuals vyho canread^t the fifth-grade level 
or higher. Spanish and Frehch language 'editions of the MIQ are available, 

* * * * 

Stage of Development: Technical information- on the development of the MIQ, reliability 
and validity information, normative data, and interpretations of sample profiles are provide 
in a manual. 

Application. A related document, the Counseling Use of tfw Minnesota Importance Question- 
naire, is a manual describing the use of the MIQ as a counseling tool. Jt contains information 
essenti^Uor the counseling interpretation of MIQ profiles and examples of its actuarial and 
clinical applications. • • 

i 

Access. 'Vocational Psychology Research, Department of Psychology, N620 Elliott Hall, c 
University of Minnesota, 75 E, River Road, Minneapolis, MN 55455 



47,. Title of Test: MINNESOTA VOCATIONAL INTEREST INVENTORY 



, Description. This interest inventory is designed to measure interests in nonprofessional occu- 
pations for men and boys over 15 years of age who are not planning -to^attend college. 

Format. The inventory consists of .158 triads of statements describing work activities. The test 
taker indicates the one activity most liked and the orje activity least likecj. Scores are obtained 
for 21 occupational scales and nine area scales. The area Scales are: (1) mechanical, (2)'health 
service, (3) office work, e J*4) electronics, (5) food service, (6) carpentry, (7) sales-office, (8) clean 
hands, and (.9) outdoors. The inventory is untimed and takes approximately 45 minutes to 
administer. A trained counselo^should administer it. * ) 

9 Stage of Development. Originally it was developed to appraise the interests of Navy enlisted 
men and to assist in their placement. It is not designed for women. The raanual warns that 
interests^ not imply ability and could cause misuse of results. 

Application: The inventory is-primarily for use with students interested in skill trades 
curricula. ' ' „ - , k 

Access: The Psychological Corporation\757 Third, Avenue, New York, NY 10017 

•\ ' <? • 1 * * • * • * ' , 

** . . <* - 

48.- Title'oi Test: OHIO VOCATIONAL INTEREST SURVEY (OV IS) 

Description. An interest survey designed to assist students with their educational and voca- 
^ ■ tional planning. 



Format* The Interest Inventory, comprising 280 work activity items, yields a profile of the 
student's interests along 24 scales representing all occupations in the 1965 edition of the 
Dictionary of Occupational Titles. The Student Information Questionnaire gathers background 
information about the student's occupational plans, school subject preferences, curriculufti ^ 
plans, post-high school plans, and vocational course- interests. Also included In the question- 
naire is a local survey section which enables users to a^k up to eight additional questions of local 
interest. It is appropriate for use in grades 8 to 13. 1 
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Available foruse.with OVIS arenhe Guide to Career Exploration and the Career Explora- 
tion £%aflat* The guide contains detailed descriptions of the 24 job clusters represented by the 
OVIS scales and a special information section for guidance counselors. The leaflet is a foLTrpage 
worksheet designed for use with the guide to help students identify and record information 
relevant to their educational and vocational decision making. No hand-scoring keys for OVIS 
, are provided since hand-scoring would require scoring each document 24>times. The Psycho- 
logical Corporation's Scoring Service processes the answer documents. 

. Stage of Development', Percentile ranks and stanipes corresponding to the_24 scale scores, by 
grajie and sex, are available. m . 1 



Application: For use in counseling arid career planning. 

Access: The Psychological Corporation, 757 Third Avenue, New York, NYJ0017 



49. Title of Test: RATI-NG SCALES FOR VOCATIONAL VALUES' INTERESTS AND- 
ARTITUDES (VIA) : . ' 

Description: Thete ratihg scales attempt to integrate a student's self-assessment of vocational 
values, interests, and aptitudes for several o<$ upatiohal area's, to determine the extent of interest 
in 20 areas applicable to career planning, to ascertain th/ degree of aptitude a person believes 
he or she possesses in each, and to discover the amAunr of valye a person places on each of these 
Classifications. . ' • / 

Format: There are three rating scales; each is presented on a separate sheet with instructions 
printed on the scale itself. E^ph scale consists a^the same 60 activity items to which an 
individual responds, using a seven alternative response format. These alternatives, corresponding 
$o the appropriate'scal^are described on the front of each rating scale sheet. Answers are 
marked directly on a disposable sheet. 

Stage of Development: reforms are based on responses of high school.and college students. 
Pepcentife Conversion tables based on the responses of 645 individuals are presented separately 
for males and females - < 

Application: The scales provide the means for effecting an integration of vocational values,/ 
^ " interests, and aptitudes to produce data whigh may be Applied against the requirements of / ( 
occupations as the individual progresses toward achieving that degree of compatibility between 
oneself and the world of work which establishes bases for involvement ina-wise career plan. 

■ % 

Access: Education and Industrial Testing Service, Box 7234, San Diego^CA 92107 • 
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Title of Test: SELF-DIRECTED SEARCH (SDty- 2Torms Regular Form E' I 

Description: .The SDS is a self-administered and self-scored counseling aid based on Holland's 
theory of vocational choice. Separate sections determine a person'sresemblance to eac/h of 
six occupational or .personality, types: recfjistio', investigative, artistic, sociaLenterprising, and 
conventional. Form E is appropriate for a*du^with limited reading<skiHs. 
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Format. The SDS consists of 228 items including items related to preferred activities, compe- 
tencies, occupations, and self-estimates. The'scores of the SDS are in three letter codes related 
to Holland's six personality t/pes. An occupational finder is available to look up grades. The 
SDS is suitable for persons aged fifteen and older. The upper and lower limits have no; been 
well investigated. Thirteen^ and fourteen-year olds have taken the SDS successfully when it is 
administered jn groups of three to five. People with high school education usualfy have little - 
difficulty. Most people complete the SDS in 40 to 60^jinutes. - 

tftage of Development: In terms of reliaoility, the corrected split-half reliability coefficients 
for the summary scales range from .83 to .93. In short, the 38-item sumn&ary scales formed by 
,ardding all R-items, all l-items, and^o on, have a high degree of inte rnal consisten cy. In terms 
of validity, a new scoring procedure for the SDS hc£ the same predictive, validity as the old/the 
shift to a simple additive scoring scheme has not affectefyhe predictive validity or the codes 
obtained from £he SDS. * 

Application: The SDS can be of use to the rehabilitation counselor with a large caseload. Use 
of tne instrument could stimulate vocational choice exploration and possibly reduce the time 
requWd in face-to-face contact with the client. 

-Access. Consulting Psychologists Press Inc.,. 577 College Avenue, Palo Alto, CA 94306 

• ' • \\ ^ ' . 

Title of Test THE STRONG -CA MPBt L L INTEREST INVENTORY. (SCll) 

Description. This interest inventory gives persons information about themselves and what will . 
help them rfiake decisions about their life plans; it provides information to counselors and other 
professionals tend helps in studyihg groups of persons. 

Format. This revision and extension of the Strong Vocational Interest Blank merges the men's 
and women's forms. The Inventory is in seven parts: Occupations, School Subjects, Activities, 
Amusements, Types of .People; Preference Between Two Activities, and Your Characteristics.^ 
It yields scores on sfx General Occupational Themes, 23 Basic Interest Scales, and 162 Occupa- 
tional Scales. ^ y 

average time for completiSn of 'the inventory is 30 minutes; the reading level js about 
. sixth grade. T„he SCU has been found to be most beneficial (for persons oyer seventeen years of 
age. Scpring is too complex to be completed by hand; a scoVing service-must be used. Profiles • 
that relate frie-General Occupational Themes to the Basic Interest and^acupational Scales are 
the usual oujput. rffrwever, some scoring services^provide interpretWeflMes printed individuall 
by computer. ,* ™ f * * 

Stag? of Development: Twp-week and 30-d<fy test-retes f t corrections are presented for each set 
of scales. Me'dian correlations, even for thd shorter General Occupational Themes and Basic 
Interest Scales, are above .86 for the 30-day interval and above .90ior the two-week interval. 
The General Occupational Themes and Basic Interest Scales haye content validity due to the 
iterrr selection procedure. Each type oFscale pfeserTTCCMTarcDTn^ in 
specific occupations scorfe-high on appropriate scales. 

* * > ... 

^Application: The SCll permits the counselor to discuss broad thtemes besides specific occupa- 
tions that may be more appropriate for rehabilitation clients. ■ * 

Access: Stanford University Press, Stanford, CA 94305 0 . * 
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.52. Title gf % Test: TEST OF' ADULT BASIC EDUCATION (TABE) . ' 

t t Description:* TABE is an achievement battery (reading, mathematics, and language) intended 
for adults auira.de 2 to 9 reading levels. 

Format; JPtie test is intended to establish the level of instruction for adults should begin a&d 
to identify instructional needs in the basic sKills. Subtests are: Reading (Vocabulary, Compre- 
t hensiQj^/Mafhem'aTlcs (Computation, Concepts, Problems), and Language (Capitalization, 
" Punctuation, Expression, Spelling). 

- — * . The three l eve ls of TABE aljow selection of appropriate tests for students who function at 

different levels of proficiency in the skill areas. The levels are E (easy), M (medium), and D 
(difficult). The working time fonpach test sectiqn represents the time that elapses from the 
beginning to the cpjjipletib'flof^mests (Level D-1 76 minutes; Level E-94 minutes; and 
^ Level M-1 58 minutes}. Adherence to exact time limits is important. • . m 

* ^ m Two types of answer sheets are availabfe: the complete bajttery answer sheet with all tfcsf 
. Sections on? simple form, and the SCQREZ answer sheet with separate forms for the reading, 
mathematics, and language skills a^eas. ' • % v 

Stage of Development: Norms are based on 1963 standardization of the 1957 California 

Achievement T§st. No adult norms are available and minorities are not mentioned in standards — 

, zation. 

0 Application: The.results from the battery*tar\bQusedtto place students in appropriate learning 

groups and tp select educational ma%fcl*for students^o use in overcoming deficiencies 
r * revealed by analysis of their test per/ornianGe.- * '/ . < 

.Access: CTBVMcGraw Hill; Del Monte Research Park, Mpnterey„CA 93940 (main office) 

53. Tiffi of! 'est: VOCATIONAL INTEREST, EXPERIENCE, AND SKILL ASSESSMENT^ (VIESA) 

description: This inventory (VIESA) covers three areas: interests, experiences, and skills. 
' "Data, Ideas,; People and Things" dimensions are used to integrate information about "Self and * 
■ the World of Work." * '* 

Formats The inventory fobuses on students in grades 8 to 12. It is easily tal*en and self-scored Y 
1 in 45 minutes. VIESA enables students to relate themselves, through a World of Work map, to 
- six job clusters and 25 job families spanning the entire world of work. The job clusters are 
compatible with the typoldgy in Holland's theory^of careers. Job family charts cover 650 -7 " 
occupations employing more than 95 percent oHhe U.S. labor force. ^) 

VIESA consists of a Career Log Snd Guidebook for students and a 48-page useVs.handbook 
for teachers. The log and guidebook contain aids to students for taking and scoring the inven- < 
tori c s^T-he handbook pr es en ts suggestions for sc^o o l -use-of-VI&SAT-transpar e ncy mast e rs,— — = 
"discussion guides and other aids to facilitate group introduction, discussion pf results, and 
follow thrpugh. VIESA also is compatible with the ACT Career Planning Program which also*/ 
contains an ability test battery. • * , * 

y Stage k of Development: VIESA has ^een nationally normed. Reliability and validrty data are 
summarized in the user's handbook. 
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Application: The program is intended for use by counselors, teachers, or supervised parapro- 
fessionals and is intended to help students expand self-awareness, develop career awareness, 
/ and identify personally relevant career options. 

Access: Test Department, Riverside Publishing Co., 8420 Bryn Mawr Avenue, Chicago IL 
. 60631 ' u v . 

0 

54. . Title of Test: VOCA TIONAL PLANNING INVENTORY ' * 

-Description: This is a comprehensive testing program ^ \ ^dividual predict^ms of 
succ e ss i n th e major vocational curriculum-a r ea ? ^ ^ ^ O^ easaring^frtndtvtdtralV 



general ability, specific aptitudes, achievers >$rs^*- a'so transforms the resulting test 
. score data into estimates of the^average ' y/-^ ^/would most probably receive in* courses 
in specific vocational curriculum ar^/^^^^jcatiorial and, academic subject's as a 'whole. 

. Format: The battery consists o> \ ithmetfc Index, the SRA Pictprial Reasoning 

Index, the SRA Verbal Form, the V^/pf Interpersonal Values, and various, subtests of the ,„ 
Flanagan Aptitude C+assification Tt:>rand Flanagan Industrial tests. It is appropriate focgrades " 

* ' 8 to 13. The time for administration varies between two hours and 25 minutes arid two hours 
and 50 minutes. * • £ 



* Stage of Development Np information was available on intSrcorrelations. * 

Application* The programs are not to tell what area a^rson 'should enter. They are intended 
only to tell something about how good one's w/ grades"are likely to be in each of several 
curriculum areas. 1 • > , 

Access: Science Research Associates, Inc., 155 North Wacker"Drjve, Chicago, IL 60606 

4 • \ - * t 

55. Title of Test: WIDE RANGE ACHIEVEMENT TEST (WRAT)'" " 

^ Description: The Wide Range Achievement Test (WRAT) is a tool for the study of progress in 
coding aspects of basic school subjects. It studies the sensory-motor skills involved in learning, 
jt does not duplicate other tests of comprehensionjudgment, reasoning, and generalization. 

^ Format.\Jhe test has three subtests: (1) reading (recognizing and naming letters, pronouncing 
words), (2)^spejling (copying marks resembling letters, writing names, printing or writing words 
to dictation), and (3) arithmetic (counting, reading' number symbols, oral and written computa- 
tion). Each subtest is divided into two levels: LeJVel Images 5-1J), and Level II (ages 12-adult). 
Different sections of the WRAT have" varying adnrinisterrng instructions. Some sections must be 
given on a one-to-onfe basis (i.e., reading aloud). Other sections can be adrrinistered to small groups 
of up to fivfc individuals (i.e., prespelling section). Som&sections can be adrrinistered to large 
■ groups (i.e., arithmetic computation). Due'tathe nature of the different material tested on the 

WRAT, som e s e ctions are t tmed- o n d- ie n-sBco i id i?ast5rQitreiY^i^ir^ in terms of minutes^ ~ 

Altogether the WFjAT takes 20 to 30 minutes to complete. 

Stage of Development;: No attempt made to obtain a representative, natibnaf sampling for 
norming; seven states were used. Ethnic sampling was npt discussed. ^ 
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Applications: The following applications have been suggested for the WftAT: The diagnosis of 
reading, spelling, and^jtVimetic disabilities in persons of all ages, the establishment of degrees 
of literacy and arithmetic proficiency of mentally retarded persons, the checking of school 
achievement of adults referred for vocational rehabilitation and job placement, and the selection 
of students for specialized technical and professional schools: , * * 

Access: Jastak Associates, >nc, 1526 Gilpin Ave., Wilmington, DE 19806 ' 
56. We 'ofTest: WIDE RANGE INTEREST-OPINION :TEST (WRIOT) ' ' . 



Description: The approach here is to attempt # to develop an inventory of work interests and 
attitudes by portraying a variety of human activities in pictures. 

Format: The Wide Range Interest Opinion Test was desighed to cover as many areas and levels 
of human activity as possible. The activities portrayed in pictures are^fepreJsentative of those 
listed in the Dictionary of Occupational Titles. They include a wide gamut of work feorn 
unskilled labor through technical occupations to professional and managerial positions. They 
are not limited in scope and, therefore, do not intentionally discriminate against any occupational 
category or level. Specifically, the instrument consists of 450^pictures arranged in 150 combina- 
tions of three. Males and females are given the same 450 pictures, but the results are analyzed 
differently. The pictures are spiral bound in a~Te-usable booklet, or on a 35mm filmstrip. The 
answer sheet can be hand-scored or machine-scored. \ 

The report form consists of a bar graph, space for raw and T-scores, ant] work 'and attitude 
descriptions on the front page. An explanation of the terms for the subject's use is printed og 
the back of the form. In addition, the remaining WRIOT components consist of a set'of overlay 
stencils for hand scoring and a'set of.job title listings^ relating to each interest area measured: 
There are 24 stencils for male and 24 for females and 18 separate jo 6 title lists identical to 
those in the manual:' * * 

"~ # Stage of Development: The manual provides only limited data on test reliability and validity. 

Application: The specific choices may be used in vocational counseling and career planning. " 

A copy may be given to the cKent for independent planning, future reference, and consultation 

with counselor?. % ) 

0 * 1 

T ♦ 

* 4 Access: Jastak Associates, Inc., 1&2§ Gilpin Ave.; Wilmington, DE 19806 

57. Title of Test: WONDERLIC PERSONNEL TEST '', 

Description: This test is essentially a |ool for examining mental ability levels and Is intended 
^to be used as a selection instrument in hiring and j^laci^g applicants and also as an indicator of 
future possibilities. _ J^-,^— —. - ■ - 



Format: The test requirea.only 12 minutes. It is.practically self-administered. For this, reason 
it is easily adaptable to business situations. All the directions are given on the first page and 
sample questions indicate to the applicant the type of questions he or she will find. The fifty 
items on eaqh form'constitute the examination and are answered by the subject without inter- 
ruption. Jfest items include Analogies, Analysis of Geometric Figure?, Arithmetic Problerps, 
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Disarranged Sentences, Sentence PareHlefism with Prcwerbs, Similarities, Logic, Definitions, 
Judgment, DirectionTollowing using CleVicqJ^I terpsf^patial Relations litems, etc? There are 
fourteen comparable and similar forms in current use. 

Sfiage of Development: The test and each of the fourteen forrps have been "standardized in 
bysinegs situations on adults ranging in age fro.m 16 to 65. A full ranfcje of v^>rk backgrounds^ . 
and situations h§ve been included in the many normative populations usedwComp^rative norms 
for large groups of adults applying for jobs are given in the test manual. A 1 * 

Application: The test was designed for adults in business and industrial situations. 

..Access: £ F r Wojidedic & AssodatesUnc^ P.O Box 7, NorthfiekO L 60093 

1 
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SECTION D 



EXPLORING THE RESOURCES IN 
A COMPARISON OF COMMERCIAL 
VOCATIONAL EVALUATION SYSTEMS 

(Botterbusch) 



. two excellent resources on work sample assessment exist: Backer's Volume II (1979b) and 
this study by Karl Botterbusch (1980). Anyone responsible for selecting work safople devices should 
be familiar with both. Botterbusch reviewed fourteen such devices; Backer reviewed thirteen. , 
Botterbusch's analysis is referred to here since it is somewhat more comprehensive. 

i ) - 

The numbers in the following descriptive charts refer to the numbers listed in the outline beldw 

v that was used in Botterbusch's analysis. As you are reading the information on the charts, you-may 

.need to refer back to this outline. % * I 

1. Developmeht / 1 

a. Sponsor . 

b. Target Group , » 

c. Basis of System 

2. Organisation m * 
* a. Number of Work Samples ( % ^ 

b. Grouping of Work Samples 

c. Manual . • 



'3. Physical Aspects ; 

a. Packaging of Work Samples 

b. Durability 

c. ^ Exoendable*Supplies . 

d. * Repfljtement 



Wcfrk'Evaluation Process x 

a. Preliminary Screening 

b. Sequence of Administration 

c. Client Involvement * \ - 

d. .Evaluation Setting * 

e. Time to' Complete Entire System 

Administration- * . * 

a. Procedures. *• ^ 

b. Method of Instruction (jiving f 

c. SeparatioQ of Leafning/Performance 

d. Providing Assistance to Client 

e. Repeating Work Samples 
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6. Scoring and Norms • 

a. .Timing v 

b. Timing Interval . , - 

c. Time Norms 

d. Error Scoring 

e. Scoring Aids 

f. Quality Norms 

g. Emphasis in Scoring t $ 

7. Observation of Clients - / *i 



•* 5 a. Work Performance 

<\ b. Work Behaviors 

c. Recording System, . 
, . • * d. Frequency of Observation 

> 

8. Reporting 

a. Forms 

b. Final Report,Format 

f 9. Utility 

a. Vocational Exploration 

b. Vocational Recomrpendations 
'c. Counselor Utilization 

10. Training in the System 
V. Training Required 
t). Training Available 
„ c. Diiption 

d. Follow-up 



11. Technical Considerations 
■ a. Norm Base 

b. , Reliability 

c. « Validity 
• * 

12. Reviewer's Summary and Comments ^ 

13. «Addresfc 

f 

H. Cost (as of mid-1980)' 
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58. COMPREHENSIVE OCCUPATIONAL ASSESSMENT AND TRAINING SYSTEM (COATS) 

1a. Prep, Inc. ' ♦* „ " ' 

b. - f manpower, secondary education, and rehabilitation 

c. v research studies of need areas • * 

2a. 4 components-job matching, employability attitudes, work samples, and living skijls 
. b. 26 work samples; each islndependent 
c. separate'manual for each component, contains all' details ; 

• 3a. eactrseparately packaged" [in a portable container 

' b. durabje 

c. woofl; sheet metal, wire, £tc. 

d. supplies locally 



4a. not required 

Jd. components and work sfamples may be given in any order 

c. extensive client involve/nent 

<d. classroom atmosphere 

e. 52 to 93 hours 



5a. specified in detail t\ Z' '* y \ 

b. audiovisual 

0:; very little ' ' * 

d. (ittle assistance after timing begins f 

e. not spfecified^ * 

6a. evaluator times client or client times i self ~/\ 

b. ^not specified 

c* . computer generated scores, hand scored option for work samples 
d: compared to standards 

e. • not usrid 

f. skill rating 

g. - quality 

1^: . no factors recorded 
p. some factors defined 

c. none used; ifiumber of behaviors recorded 

d. not specific 

8a. standardized forms for all phases 
b. computer based printout, four page optional hand scored evaluation report 

J *v 

9a. extensive occupational information given to client 

b. specificjotts and groups of jobs 
' « c. designed f pr client self-Interpretation 4 

'10a/ no' 

'b. yes • 

c. 3-5 days 
* tf. yes 




11a. 
b. 
c. 

12. 



student noKns on'work samples 
data in manuals i 
data fn manuals 



Reviewer^ Summary and Comments — The COATS is the most comprehensive evaluation 
system presently available for use in educational anct rehabilitation settings. The system 
is logically consistent, well designed, and based on a wide range of research studies; Two 
unique aspects are: (1) the emphasis upon the client using the results of the assessment 
to plan and, hopefully, change his own behavior and (2) the fact that each component 
^can be used independently. This means that a facility could use, for example, the Wor 
Samples and Job Matching Systems in an evaluation unit, the Employability Attitudes 
System in awork adjustment program, and the Living Skills System in a literacy training 
program. The COATS was designed basically for school populations and this results in j 
several potential problems for rehabilitation facilities: (1) the clifent must be able to read 
* at about the eighth grade level to use the written materials effectWly, (2) the use~bf 
audiovisual format and separate answer sheets may present some problems for persons 
with hearing, visual and/or learning handicaps, and (3) Accept for the hand scored work 
sample option, the turnaround time of one week is a problem for facilities that typically 
have a two to three week period of evaluation. From a technical point of view, the 
weakest component is the Work Samples, which cfb not presently contain adequate 
norms. i \ 

13. Address: Prep, Inc., 1575 Parkway Ave!, Trenton, NJ 08628 



14. , Cost: The cost of each component is as follows: * - 

1. Job Matching System (15 cartridges, manuals, and' 

forms for 20 persons) * * , $2,080.00 

2. Employability Attitudes (6 cartridges, manuals)^ % * 1,285.00 

3. Living Skills (6 cartridges, manuals, arrd forms*for 20 persons) *' Vv 1,275.00 

4. Work Samples Y^ice of work samples^ range from $435.00*to $1,458.00; the 
average price is'$897.00. Each work sample^cbmes with tools, cartridges,* guides, 
anji consumables for 20 persons. Average scoring cost per worJ< sample is $5.00 
per person. * ■ 



^59. HESTER' EVALUATION SYSTEM 



1* 



1a. Goodwill Industries of Chicago 

b. all intelligence levels, physically disabled 

c. DOT ^ 



'2a. '28 test scores 

b. grouped into 7 factors 

*c. contains most system details 

3a. some individually packaged 

b, estimate fairly durable 

c. staples and paper 4 

• d. supplies locally, parts from distributor 
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4a. not required 

»b. no specified order * 

c. little during testing 

d. formal testing setting 

e. 5 hours 



A 



5a. omits many details 

b. oral and demonstration 

c. 'riot applicable 

d. no assistance after timing begins 

e. , if necessary, after two weeks 

V 

6a. evaluator times client 

b. varief with type of test 

c. , no separate time norms given \ 

d. no separate error scores given 

e. not used m "* ' - - 

f. not used 

' g. time to completion of numibeNrf rpSp'oases 



7a, b, c, d. Because the Hester uses pjsychological'and psychophysical tests, no behavior, 
observations are made * . ' * * - 

8a! * standardized forms for anaphases ^ . 
b. \computer generate^ report Jists specific jobs andother data 

* 9a. |ittle use to client " r 

b. completely related to DOT " - 

c. designed for counselor's use i — - 

^10a. yes , 

b. ' yes 

c. 2 days . . . | 

d. not specified 9 . ^ 



v 11a. little information available * 
-b. test-retest reliabilities high 
c. manual contains very little data l 

. r • ' > t I . . ' - 

„. 12. Reviewer's Summary and Comments — The Hester uses the trait-and-f actor approach 
^ that has been used as a test development model for over 40 years. This approach has 

^ proven successful for many psychological te£ts. The Hester attempts to present a 

^ • picture of the client's abilities and tamatqh these abilities with the structure of the 

DOT. The logical structure has-a definite appeal to persons who stress ability testing 
as part of the vocational evaluation process. It muSt be emphasized'that the lack^of 
detailed information on the development and the validity of the system is a major 
souro?fef concern. While descriptions of the development process and the scoring * 
procedures aYe critical' for all work sample systems, they are even more'cri^ical ip a 
system that handles § large mass of data in ways that are not really avaUable for the 
• - user's inspection. The lack of details on the process, coupled wjth the almost total 

• - ^ : • J ■ • 
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lack of technical data, force the»potentTal user to accept the results on faith. Tha Hester 
realizes the need for occupational information? interest determination, accurate 
^^behavioral observations, and evaluator interaction with the client. The Hester could be 
/Dest^iescrib&d^Sva very logical series of tests designed to relate client abilities to the * 
. Data-People— Things hierarchies of the DOT. The system is probably t^st used for • 
initial screening at the beginning of the vocational evaluation process. 

• •' • * ( 

Address: Evaluation Systems*lnc., 640 N. LaSalle St., Sgite 6?8, Chicago, I L 60610 

Cost: The, total cost per installed system is $7200.00. This includes all testing equip- 
ment, paper-and-pencif tests, data sheets and forms for 100 clients, and-training. 



60. JEWISH EMPLOYMENT AND VOCATIONAL SERVICE (JEVS) WORK SAMPLE SYSTEM 

1a. . U.S. Department of Labor 

b. , initially for disadvantaged * 

c, DOT 



.2a. 28 i . ' 
* b. 10 Worker Trait Groups 
c. contains all system details 



3a. each work .sample packaged separately 

b. very durable • K 

c. paper, fabric, string 

d. % rflost purchased locally/ ^ * 

4a. no n required > 

b. progressive from easiest to hardest 

c. some/ * • 

d. realistic work.setting stressed 
e" 6-7. days • 



5a. specified in detail 

b. oral and demonstration 

* c. * minimal * * • * 

d. ° assistance lp,yve'rs score 

e. not recommended * \. • 

6a. client'uses time clock * v~ 

b. ' fromend of instructions td completion of task 

c. ratea"5rT3 point scale 

d. • random check, compared to standards * 

e. : minimal use 

f. * most rated on | 3 point scale 

g. tirhe and quality given equal weight 



specific;"4' gerteral factors specified 



7 a -7 16 - 

b. I clearly defined 

c. • 3point'rating"scale. 

d. - extensive observation 
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ba. ■ standardized.forms for all phases ■, 

b. . standardized format .recommends Worker Trait Groups. 

9a. limited use ( 

b. highly related to the DOT • , 

c. orientated toward counselor 



10a. 

* c. 
d. 



11a. 
b. 
c. 

12. 



13. 



14.- 



yes " , ■ ' 

yes ' - . ~ 

1 week • * 

■yes *. . 

1300 clients 4 * 
no data available 

no recent data are available , % V 

Reviewer's Summary and Comments - The JEVS System is a highjy standardized and 
well integrated procedure for client evaluation.based on ten of th'e'DOT Worker Trait „ , 
Groups. The strongest points of the system- are its stress upon careful observation and 
accurate recording of work behaviors and performance factors. The use of a trait-and- 
factor approach ties in well with the assessment of specific abilities. The major problems 
with the system^ppear to be the abstract nature of many of the work samples, which 
hinders vocational exploration, limited evaluation feedback to the client, and the lack 
of job information presented to the client. The system is best used when aVthorough 
evaluation of the client's potential is desirfed. * 

Address: \/ocational Research Institute, Jewish Employment and Vocational Seh/ice, . 
1700 Sansom Street, 9th Floor, Philadelphia, PA 19103 

Cost: $7,975.00 includes all work samples and forms) shipping, tuition for training 
one perscjn in Philadelphia and one on-site visit by JEVS staff. The cost of transportation 
and living expenses-for the persotf to be trainffd and for the JEVS staff for the, one on- 
site visit are not Included in the price. , ^ 



McCARRON DIAL - WORK EVALUATION SYSTEM, fM OWES) 
1a. McCarron & Dial 

b. mentally retarded, mentally ill, learning disabled ^ 

c. 5 neuropsychological factors' 



2a. 17 

b. grouped into 5 factors 

c. 4 manuals; very detailed 



3a. . 5 separate briefcase-like kits , 

br not applicable 

* c. no consumable materials used 

d. >must be ordered from manufacturer 
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4a. client interview 

b. in order by factors ' 1 

c. encouraged 

d. formal testing and workshop 

.e. 2 weeks recommended ♦ , 

5a. specified in detail 

* b. orj^ahd demonstration 

c. not applicable 

d. little assistance provided > * 
if nepessary • - 

,6a. evaluator times client 

b. , specified time limits 

c. some separate time norm* * 

d. 4 compared to standards- - 

e. " not used 

combined with time norlris for overall score 

g. quality 

7a. factors identified 1 

* clearly defined ' % . 

c. N « 2 separate instruments used *^ ' 

J, d. 2 hoyrs foj 5 days , " • ^ 

„8a.' standardized forms for all areas v 
b. prof He of results and recommendations ■ N 

9a. little use to client' * 7 

^ 1 of 5 program -areas is recommended . ' 

z. disability .determination 

10a. yes. v ■ ' V . 

b. yes' 1 
c* 3 days* 

d. not required x ( 

1 1a, several g'roups of disabled" ctfents , 
. b. high ,80's; low .90's 

c, considerable data in manuals; separate studies in literature 

12. Reviewer's Summary and Comments - TbeMcCarron-Dial was designed for the purpose 
of assessing the mentally disabled person's ability to function. It uses a.combination of 
widely accepted individually administered psychological tests, assessments of fine. and 
gross motor ability, and an Extended period of observation. Rather than discard those 
tests which have proven useful, or to rely solely on performance and behavior observa- 
o tion, the McCarron-Oial»attempts to combine them intqa single' prediction tool. It is 
encouraging to note that tome derailed, welWesigned studies have been conducted with 
the MDWES. In a vocational evaluation setting,' the 'system may achieve its best use as 
a preliminary assessment device for assessing general levels of functioning prior to a 
systematic exploration of interests and specific skills. 
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13. Address. \McCarr6n-Dial Systems, P.O. Box 45628, Ditfes, TX 75245 



14. Cost: The five separate kits are priced as follows:* 

Auxiliary Component - $168.00 SSSQ -$125.00 

HVDT * > - 296.00 HMMT - 490:00 

MAND i - 336.00 - - ' 

; Manuals are included in the kits; however, manuals rr^ay also be purchased separately. 
\ 

62. .MICRO-TOWER 

1a. ICD Rehabilitation & Research Center* 

b. general rehabilitation population " . 

c. DOT 

** . • 

2a. 13 

b. 5 groups of general aptitudes ✓ ' 

c. . general manual, separate manual for each work sample contains all system details 

. c 3a. each work sample packaged separately ' • ^ 

b. , durable , 1 - 

c. wire only N ♦ T 

d. all forms locally if desired 

• » 

4a. not required 
k b. discretion of evaluator 
c. extensive client involvement - 

ti. p combinafion of formal testing and counseling • - # 
e/ 15-20 hours 4 - " rt 

5a. specified in detail > 

vb. audio cassette, evaluator demonstrations 

c. stressed, almost total 

d. no assistance after timing begins 

e. not specified - , r 

6a. cassette tape ' ^^mf^m^g^.. m 

. b. specified time for each work sample 

c. «. no time norms used ' 

d. number completed; pieces correct , 1 ^ 
, e. some use , 

f. rated on 5 point scale 

g/ emphasis on quality ' 1 

7a. no specific factors defined 

b. 5 work behaviors listed 

c. ' none r § * 

d. frequent observations expected v 

8a. standardized forms for'all phases 
b. 3 separate fonhs used to report different results 

* 
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9a. • some direct client use % f 

b. related to DOT • . 

c. designed for counselor use 

10a. no ; - 

. b- yes ' • % t # * . i 

c. 2 or 3-days * ' ( /W 

d. not specified * , 

'11a. 19 different norm groups I ' . . 

b. adequate dafta in manuals; high reliabilities 

c. construct concurrent validity reported * , x m m 

12.. Reviewer's Summary and Comments — Micro-TOWER oaa^est be described as a group * 
aptitude battery that uses work sampling techniques qs the assessment nrlethod. The 
system claims to measure seven of the nine aptitudes that are used in the 'Worker Trait 

* Groups arrangements of,the DOT/GATB. The system has the advantage of being group 
administered jn a fairly short period of time, thus making maximum use of evaluatbr 
time. The system attempts to go beybnd the mere assessment o'f aptitudes by providing 
occupational information and group discussion. Adequate norms arej>available, except 

v fbr employed workers. The system generally takes a standardized,. psychological* test 
approach \frith emphasis on carefully controlled administration conditions, the separation 
of learning from performance, and the reporting of results in terms of percentiles. -One of 
the most encouraging aspects of the Micro-TOWER is the apparerft concern with continued 
development'and refinement, as evidenced by thfe numerous technical articles. One major 

* problem with the system is the lapk of thorough behavioral observational materials. . 
Another possible problem is the converse of the advantage's of a g^Qup administered test 
— the valuator may not be able to provide the client with the one-to-one relationship 
that is needed for some severely disabled persons. 

13. .^ddress: Micro-TOWER, ICD Rehabilitation, and Research Center,"340 East 24th St., 

* New. York, NY 10010 : 

T4. \ Cast: The cost "of the Micro-TOWER depends primarily upon the number of clients 
'being tested in the group. Each client requires a complete set of equipment. An addi- 
tional set of equipment is needed for the evaluator. * • 

Prices are-available for group sizes from 4 to 30, for example: 

"Number *of Persons Tested Per Group ' • Price 

~ 4 # $ 7,943.00 

• V ' 7 - 9,023.00 ^ 

< 10 v ^ v ^ 10,103.00* 

20 • 13,703.00 6 

30 17,303.00 

The above prices* include all equipment, forms to test 100 clients per work sample, one 
set of evaluator's equipment for each work sample, a cassette playback anda cue-stop • 
systefeOable easels, and photo bdoks. 
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63. PRE*VOCATIO\NAL READINESS BATTERY (VALPAR A/0. 17) /*' 9 

1a, Va^par Corporation . " 
b. mentally retarded . * ^ 

• c. . not specified . ** 

2a. 1 1 assessment techniques using different formats v - ; " / 
b. 5 areas ' ■ % y<- . - 4 

•c. generaNmanual; separate rrfanual for each area defatted / 

3a. each of the 5 areas packaged separately 

b. very durable ' .// . * 

c. " no consumable materials >; , . " t 

d. forms ordered from developer or locally reproduced * % 

4a. not specified • * 

b. any order • * 

c. considerable • k 

d. not specified - ■ s 

e. 5Y2 hours , " . „ 

5a. specified in detail ^ ' 

b. _ oral, oral and demonstration, or oral and demonstration with a sample audiovisual 

c. minimal 

.d. not specif ied \ . 

e.. strongly recommended * 

6a. only one time score usedpn,entire system 

. i> b. preset for t\\e one task .* • ■ 

c. , UB^d only for one task 

d. f£*cept for one grea, number of correct responses 
e\ npt used ' 

tf. based on total points - . f , 

g. * number of correct responses , 1 

7a. factors listed 

' « " b. some specific areas defined # ' 7 

V ' 3 p^>int rating scale >%( 

i *d. not specified * • 

8a. standardized forms for recording and*scoring" 

b. not used; depends upon facility 

9a. some direct client use 

b. largely dependent upon user 

c. results of each specific task designed for counselor usage 

10a. no , 

b. yfes v 

c. 1 day or more 

d. as requested by user 
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11a. 
b. 

c' 

12. 



13. 



14. 



"research norms". > '• > ... ' 

no data available '• . -*- • „ ' • 

no data available ^ 

Reviewer's Summary and Comment? - V^lpar No/1 J is apparently intended to be §p 
assessment of the variable^ that must be considered when assessing a mentajly retarded 
person'Syinterests, vocational skills, and social maturity. The system is designed to be 
used by a person vyhp is not trained in psychology ,*medicine,-or occupational therapy. 
The system is vyefl designed, attractive, an<tn6vel in many ways. The use of audiovisual 
and gaming marterials'will make it attractfvfe to clients as wel.l as evaluat'ors. 'Data dblled- 
tion forms are unusually well designed. The major problems are in the technical are^s. 
The y manuals contain no .background as to why certain components we're setected, no 
relationship to previous work dorie»in this field.' No data are given on reliability and 
val|dity; thereris nbt even a statement on these two factors. l|ae norms data are imfao£. 
sible to interprSt without acfditionaf information. In summary, this is a very attractive 
assessment deviceybut much more heeds to be known about it. 



Address: Valpar Corporation, 3801 E. 34th St., Suite 105, Tucson, AZ 85713 
Cost: $3 V 200 . * , ' 



SINGER VOCATIONAL EVALUATION SYSTEM (SVES) 

1a. Singer Educational Division '* * 

b. spefcial needs population * ' 

; a, groups l dT related jobs 

2a/ 25. , , 

b. each is independent 

^ p. single evaluators manual; very detailed 

b. 

c, 
'd. 



each self-contained in a cafrel 
expect som&problejns 
wood, wire, chemicals 
supplies locally or through Singer 



«4a. not required 

b. discretion of^evaluator 

* c. extensive client involvement 

d. classroom atmosphere 

e. 2% hours per work sample 

t , 

5a. speciffed in detail 

b. audiovisual ' . 

c. * little 

d. < * checkpbints built in' 

e. at request of client 
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,6a. evaluator times client • . , 

b. * varies with each work sample „ , 

c. ■ based on number of minutes to completion s 

d. ^ compared to criteria - * 4 
e» some use ' " . * \ t 

f. 5 point scale or subtracted from time secure 

g. time and errors given eqi^al weight ^* * 1 

- ' ' ' . - N 

7a. * 20 factors defined ' 4 . 

b. none listed • ' 

c. none used for behaviors — records actual observations 

<J. ' not specified . \ * 

\ 

8a. * standardized forms for all phases « . 

b. no formaf given; includes description of contertfs / / ■ 

9a. extensive information given to client 

• b. dependent upon user f 

c. dependent'upon-user 

. " 

10a. no _ * 

b. yes % 

c. 2 day^, 1 or 2 week " , * * • 1 % 

11a. clients, employed workers, MTM , ' 

b. test-retest .61 and .71- { 

c. . mostly content * * 

12. * Reviewer's Summary and Comments — +w-a / review of the Singer system published in an 
earlier version of .this publication, the System was criticized for its inadequate manual. _ 
The mQst recent Singer manual corrects for the earlier lack of thoroughness and goes on 
to provide almost all the data that the ev^Iuatbr woulcl need. The prOGess of developing 
MTM^and employed worker norms is one of thfe strong points of the VES. Also encourag- 
ing is the publication of some basic studies orvthe system. Presently, the system provides 
a measure of interest measurementand skilj assessment for jobs mostly in the skilled 
"trades and technical areas. The occupational information remains the strong point of 
the system. The^m|i[or problems lire the lack of work atmosphere, the use of expendable 
supplies, and the possible need for a superstructure to integrate thB Units into a functional 
whole. . 

' J 



13. 



Address: Singer Educational Ditfsion, Career Systems, 80 Commerce Drive, Rochester, 
NY 14623 - 



14. Cost: As of January 1980, cost per work station ranges from $1,150.00 to $1,290.00 
with thQ^^aap^ost b£jng,$1, 544.00. The price includes shipping and enough supplies 
to evaluate^aF^roicimaSry^O people. Singer us&ally wiU not'sell less than ten work 
stations initially. 
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* 65, TALENT ASSESSMENT PROGRAM (TAP) • 
1a. Talent Assessment Programs 

b. age 14 up^mental levels above trainable mentally retarded % 
*c. occupational clusters 

*2a. 10 ' . . 

b. each is independent 



c. - some 'details riot provided 

X ' • 

3a. all individually pack^jaed ^ 

b< extremely durable 

c. no qonsumable materials ' „ 

d. . locally or from distributor 

4&. not specified 

b. 8 of the work samplescan be given in any order 

c. not specified f~ 

d. jiot specified 

e. 2 1 / 2 hours k 

5a. notspecified in detail 

b. oral and demonstration 
. c. some 

d., . none : - «. 

• e. encouraged for. upgrading 

6a. evaluator times client ^ 

4 b. from end of instructions to comple.ti§n of task 

c. actual time recorded ' 

d. client corrects mistakesZn some tests 

e. not used / 

f. combined with time norms for overall score 
g^ time 

7a. no factors defined * 

b. no factors defined 

c. N no rating method used 

d. not ..specified 

8a. two standardf2ed forms 

b. profile of results and rfarrative report 

9a. very limited use • 

b. related to sp^pif ic jobs 

c. orientated toward counselor - 

10a. - yes 

b. yes ' . . 

„c. 1 1 /2days 

d. as needed 
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,11a. 7 different«norm groups # - 

„ b-r .85 coefficient of stability ' • J 

c. no data available * > # " * 

* , * * 

12, ; Reviewer's Summary and Comments — As opposed to other work evaluation system^ ^ 

which attempt -to present a C9mplete picture of the client, the TAP caij be character- 
- ized as a battery r of perceptual ahd dexterity tests designed to measure gross and fiqe 

finger and manual dexterity; visual ahd tactile discrimination; and retention of details. 

Jhgs, it is limited to the assessment of these fairly specific fatftors. The developer doe? 

npt claim that this system will assess all vocationally significant capacities and behaviors; 

in fact, the manual states that other assessment devices should be used irt addition to 
t the TAP to obtain* a complete evaluation of the client. 

13. * Address: Talent Assessment, Inc., P.O. Box 5087, Jacksonville, FL 32207 
14/ Cost: The $3,100 (and up) price includes delivery and on-site staff training. 



TESTING ORLENTAtlON AND WORK EVALUATION IN REHABILITATION iWWER) 




1a. 
b. 
c. 

2a. 
b. 
c. 



Vocational Rehabilitation Administration 
physically and emotionally disabled 
job analysis r 
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14 training areas ; , 

sfngle manual; some details not provided 



3a-d. Because ICO does not sell hardware, each facility must construct its own. This section 
is not relevant for TOWER, 1 



4a. 

b. 
* c. 

.d. 

e. 

5a. 
b. 
c. 
*. 
e.' 

6a: 
b. 
c/ 
d. 

' e. 

■' f - i. 

g. 



emphasized for planning ' ^ 

progressive within areas- 
not specified, 

realistic work setting stressed 
3 weeks * 

some specified in detail, except layout 
writteaand demonstration 
not«specified ' " 

not specified^ 
encouraged for upgrading 



evaluator times client 

from end of instructions to completion of task, 



rated-on 5 point scale A 

coirfpared tojstandSVds 

extensive use 

rated on 5 point scale , 

$me and quality given equal weight 



7. 
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7a, only one factor defined \ ^ 

b. few listed m.ftnal report 

c. o^oint rating scale 

d. ' not specified'; frequent observations assumed > 

«> 

<> . ' ♦ ' 

8a. standardized form for all phases 

b, narrative report using standardized outline and ratings • 

a * * / ' 

9a. exposure to a variety of work areas 

b. limited fo jobs related to work areas 

c. - orientated toward counselor 

10a.' yes 

b. yes 1 

c 3 weeks 

' d, no < • ' • 

11a. clients r~ ^ 

b. no data available » 
p c. equivocal results 

12. Reviewer's Summary and Comments - The TOWER Systemls the^ldest complete 

* work evaluation<system an'd over the yearsitas served as a model fpr ttje development 
of many work samples. The TOWER uses a reajistic job setting to thoroughly evaluate v 
clients for a rather narrow group of jobs. The facts that the TOWER was based on job 
analysis and that the system has been used for many years to place and train handicapped 
peddle are indications that* the system is very useful in evaluating clients for a small * * 
group of jobs. The lack of precise definitions for work performance factors and client 
behaviors and the lack of adeqyuate norms are the* major weaknesses of the syatem. The 
high use of written instruction?tmd the high level of the areas evaluated restricts its use 
with low literate and mentally retarded clients. 1 - 

' * -J' ' 

13. Address: ICD Rehabilitation and Research Center, 340 East 24th St., New York (MY 10010 

14. Cost: $300.00 for three copies of all wo/k samples and forms; training tuition is $150.00, 
which includes manual. Note: No hardware is sold by ICE; each facility constructs the 
work samples. IGD estimates cost to set up unit at about $5,000.00. 



67. VALPAR COMPONENT WORK SAMPLE SYSTEM 



1a. Valpar Corporation 

b? general population, industrially injured worker . * 

c. trait and factor * / 

*» 

2a. 16 ^ 
■ b. each is independent 

c. separate manual for each work sample; most material detailed 

3a. all individually packaged 
• very durable 

c. few consumable supplies used 

d. 'order from developer - ^ 
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9t" required 

discretion of evaluator 
mininal . 

not specified > * 

estimate about 1 hour per work sample 



spec 
oral 
nonfl 
not 
encc 



fied in detail \ 

and demonstration: some reading 



pecitied 
uraged 



evaluator times client ' * 

fronr end of instruction to completion of task 

actu \\ time recorded 

' somi s scored separately; others combined with time scores * 
sormiuse ? 
separate norms 

4 weighed combination of time and errors 

no factors defined • * . * 

17 factors defined " 

5 point-ratipg scale / . \ 
-not specif ied j _ 

separate form for each work sample f 
nons used; independent wor^samplea 

limited use, * 

depends upon use in facility • 
cannot be specified m% 

( 

•no 
yes 

as needfcd 

~ as needed . ^ • * 

6 different norm group's: MTM norms 

data available; cannot be assessed ^ 

no data^available «, ( ^ 

Reviewer's Summary and Comments - The Valpar Component Work Sample System } 
currently consists of sixteen individual work samples which are physically well designed 
and constructed They are appealing to clients and lend themselves to easy administra- 
tion and scoring. Individual work samples can be easily incorporated into aQ existing 
evaluation program. Because these individual work sahiplescan be purchased as needed 
by facilities, there are no unified final report forms, and other aspects of an integrated 
systemTre lacking. The major problem with the Valpar is in the area of relationship to 
jobs. According to the manuals, each 'component is keyed to a number of specific occu- 
pations as well as worker trait groups. However, the manuals offer no convincing evidence 
that, for example, one w^rk sample'could be related to ten Worker Trait Groups. 



13. Address: Valpar Corporation, 3801 East 34thSt.„Tucson, AZ 85713 

14. Cost: Individual work samples range from $495.00 t9 $990.00. Any number of work, 
samples can b.e purchased. 

VOCATIONAL INFORMATION AND EVALUATION WORK SAMPLES (VIEWS) 

1a. Philadelphia JEVS 

b. mentally retarded , * 

c, DOT /* . , 

2a^ 16 «- **„*">' 

b. 4 areas of'wbrk , • 

c. very detailech 4 

3a. most individually in portable plastic cabinets 

bj, very durable m jm» 

c. paper, string, fiberboard ^ 

d. v^supplies locally; parts from developer 

4a.' not required 

b. progressive from least to most complex 

d • extensive client involvement • 

d. realistic work setting stressed j 

e. .20 to 35 hours . . 4 

5a. specified in detail 

b. oral & modeling, flexibility to use a variety of techniques stressed 

c. almost total; weU established criteria 

d. little assistance after timing begins 

e. repeated if considered necessary 

6a. evaluator times client 

b. after task is learned to completion* 

c. rated on 3 point scale; also MODAPTS 
, d? « compared to standards' 

e. some use • \ 

f. • rated on 3 point scale * 9 

g. • time and errors given equal weight # 

7a. 10 factors defined * . " 

b. clearly defined r ^ * 

c. • specific behaviors reported * 

d. extensive • * \ 

8a. standardized forms for all phases 

b. standard format containing behavior data and recommenced Worker Trait Groups 

9a. little use to client 

b. -related to DOT 

<j. oriented toward counselor 
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10a. yes ♦ 

b. yes 

c. 1 week 

d. yes 1 

v » 

11a. 452 mentally retarded MODAPTS 

b. no data available 

c. no data available 

12/ Reviewer's Summary and Comments - The VI EWS^ attempts to evaluate the vocational 
V potential of mentally retarded adults for jobs in six Worker Trait Groups. The system 
relate? to job areas that are very common in the national economy and more important 
to job areas where many retarded persons have found successful employment. The most 
unique feature of the system is the atternpt to separate learning 'from performance. The 
developers believe that the client should be thoroughly taught the task prior to perform- 
ing it under timed conditions. The VIEWS also uses standardized behavior observations 
which are combined with time and quality scores to produce a well organized "final 
report. The major problem with using^the VI EWS by itself is the lack of occupational 
information. 

13. Address: Vocational Research Institute, Jewish Employment and Vocational Service, 
1700 Sansom St., 9th Floor, Philadelphia, PA 19103 

14. Cost: $.7,675.00 includes: work samples, manuals, forms, shipping, tuition for training 
one person in Philadelphia and one on-site visit by JEVS staff. Living expenses and 
transportation are not included in thie price. 

69. VOCATIONAL INTEREST TEMPERAMENT AND APTITUDE SYSTEM (VITAS) 

1a. Manpower Administration 

b. employment service applicants 

*c. DOT 

2a. 21 ! ' 

b. 15 Worker Trait Groups A> 

c. detailed - . " • 

3a. each packaged separately* k 

' / b. very durable . • „ ^ * 

• c. paper, string, sheet metal 

d. supplies locally; parts from developer _ , • * 

* , — 4a. not specified — x 

bT progressive from easJBtet to most difficult ! j 

' « c. considerable client involvement ■ N 

1 d. realistic work settling stressed 

e. 15«hours 
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5a. ■ tpecWtedm detail * 
b. oral & dWfortstration 



c v [^separation I 
tjplimu m assistance N t \ 

tjpt recommended' ' ^ 



d.i 



6a., etfaluator times client 

b. • after instructions until task competed 

c. ^ rated on 3 point scale @? 

d. compared to standards * 

e. no use ^ » 

f. rated on '3 point scale - 
, g. time and errors given equal weight 

4 7a. ( 9 factors defined * 

b. several general factors 'defined 

c. specific behaviors reported * 
* d. almost constant observation stressed 

8a. standardized forms Cjsed for all phases 
b., standardized format; stresses Worker Trait Groups , 

9a. little use to client 
b. related to DOT & supportive services 4 
c> aimed at counselor 6 

V)a. yes 's i 

b. yes . > 

c. 1 week * 

d. , yes ^ 

*• 

11a. 600 CETA clients ^ 

b. no' data available - ■ 

c. no data available ■ * 

j ' 

12. Reviewer's Summary and Comments - The VITAS System is the third work sample 

system developed by Philadelphia JE VS. Like the JEVS^and VIEWS systems, it stresses 
the importance of careful and accurate behavior observations. The systenh also uses the 
work sample to WTG approach t$at has served J EVS and VIEWS so weH in the past, 
it must also be pointed out that many o? the VITAS work samples are refinements and 
modifications of the original JEVS system. While th^ system could provide accurate 
assessment of CETA populations in a relatively short period of 'time, it has two problems: 
(1) a lack of client occupational information, and (2) the failure to make any rd^l 
distinction between learning and performance. The emphasis upon close client contact, 
careful observations, and the practical reporting format are the three major advantages 
of the system. „ ^ ^"N^ 

13. Address: Vocational Research Institute, Jewish Employ merit and Vocational Service, 
1700SansomSt.,9th Floor, Philadelphia, PA 19303 

14. C^t: $8,190.00 includes work samples, manuals, forms, shipping, and tuition for 
training one person in Philadelphia and one on-site visit. Living expenses and trans- 
portation are not included in the price. 
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70. VOCATIONAL SKILL? ASSESSMENT AND DEVELOPMENT PROGRAM 
(BRODHEAD-GARRETT) 

1a.- Brodhead-Garrett 
b„ handicapped and disadvantaged 
c. not specified ^ 

2a. ***18 work samples - Phase 1 
b. Phase sdrting, assembly, and salvage; by 3 phases 
-c— separateirtanuat-fof-each-phase. Phase 1 lacks many details 

3a. Phase [ — packaged in large wooden cabinet 

b. very durable 

c. Phase I — minimal amount 

d. assumed to be from loqal sources 

4a". not required , " 

b. discretion of user V 

c. ( assume fairly high degree of involvement ^ ^ 

d. mostly classroom s . 

e. reviewer estimaterPhase I in 1 week 

5a. not specified p * - 

t>." oral & demonstration v - 

* c. some . • 

d. not specified „ ^ \ 

e. i permitted to correct excessive errors ^ . - 

6a. evaluator .times client ■ \ 

b. from end o#pr£Cticeto completion of task / 

c. reported on -3. point scale 

d. ■ not specified 

e. not used [ * 

f. no separate qualfty norms , 

g. time and quality (Jiven equal weight 

7a. no factors defined * 

• ' j b.« 36 defined *♦ * , 

* c. 5 point scale ■ , 
d. not specified . 

\ • . 

<- 

«8a. .standardized forms for recording scores and work behaviors 
i h -b; 4 page firial report/topic headings 

( • 9a. extensive, especially with Phase II 

, b. by job area ... 

c. not specified * ' . ' & 

* 

10a. none 9 • ' 

* b. yes - * 
f c. 2 days to 1 week . * i * 

. d. as needed 
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no data available 
no data available * 
no data available 



13, 



Reviewer's Summary and Comments — the Bjodhead-Garret| is a system that isMntfcnded 
to provide continuous service frorn initial assessment through training and, eventually 
job placement. In this aspect it is unique. Phase I is the only .part of the system thgjt cam 
'be considered as a work evaluation system as this term is*usuallyused in vocational Z^* 
evaluation. Phase I lacks detailed evaluation and client instructions, norms, proper setup 
procedures, and scoring methods. Hn short, the manual for Phase I dote not give the 
evaluator enough infonj^ation to accurately use the system. trfusinfl.Phase I, the evalu- 
ator must also.ask how the content of assessment^ tasks is related to the specific training 
given, in the other two'phases. The -success of Phases II and III depends on a larcje part 
upofi the quality of instruction and the physical facilities* These two phases have the 
potential for being very useful for training clients in.both* basic # skills and for some entry 
level positions. v « • <-> t « ' 

Address: Brodheacf-Garrett Company, 4$60 East 71st St* ClevelaVflSl, OH 44105. 



14, . Cost: v Phase hmanual and equipment are approximately $5,95P$I3. Phase II andPha?e*NI 
costs depend upon how many tools, eqififtment, and materials are presently available 1 
with the facility or* school. If all Phase II and Phase ^hardware 'and software were to \ 
be purchased, the cost would £e about $48,000. Sofflpire costs.for each Phase [I and 
Phasafl 1 1 component is $375.00 per manual. * * 
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WIDE RANGE EMPLOYMENT $AMPLET$ST (WREST) 



1a. 
b. 
c. 

2a. 

c. 



Jastak A&ociates 

severely disabled - mentally and physically; 
not specified * , 

10 

each wQrk sample is independent ' v 

well organised manual; contains all details . 



3a. „ system Rackaged in wood cabinet 

b. durable 

c. * mostly paper products , 1 ' 

d. from developer 



4a. not required ' 

b; discretion of evaluator 

c. clienwtold purpose and use of results 

d. ' not specified 

e. VA hours 

5a. specified in dWil; can be group administered 

b. oral & cjflponytration ' s 

c. conside^fle. 

d. none given after timing starts , , 

e. encouraged for upgrading 

"** * /j ^ 
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6a, evaluator times client 

J>/ from eTid of instructions for a specified period of time 

c. time to completion; compared to scaled scores 

d. , compared to standards . 

e. not used 

f. all errors totaled for a single quality, score 

g. time , 

7a. - no factors defined i( . 

b. ' 10 defined in generakt&rms 

c. scale from 1 to 18 

d. not specified . 

8a^ standardized form for recording performance 

, b. numerous examples given in manual 



9a. limited use 

b. . not specified 

c. . not specified 

♦ *10a. .none • 

, b. none . * f . 

1 * c. not applicable 

v d. not applicable 

11a. 3 major groups; characteristics well defined 

; b. . test-reTest .coefficients in .80's and\90's 

c. correlations between scores and supervisor's ratings .86 and .92 

• f % 12. % Reviewer's Summary and Comments — The WR EST consists of tefi short, low- level tasks 
apparently 4 desigrted to assess mainly the maeipulation and dexte.rity abilities of the 
» . client. Although it is not stated in the manual, the WREST seems fnost useful in 
ft assessing new clients for assignment to suitable work projects within-a sheltered work- 

shop. The emphasis upoTi repeating the work samples many times shoiild provide an 
evaluation of the client's ability to improve his performance under repeated practice 
conditions. The major problems of the system center ground the lack of systematic f 
t * behavior observations, failure to relgte results' to the competitive job market, and the 

apparent lack of a useable final report for tfie referring counselor or agency. Finally, 
*. * the WREST has an adequate norm base, good estimates of test-retest validity, and 
attempts to establish concurrent validity. In a field that is alftoo often characterized 
by poor technical development, the WREST can serve as a good exargfcle. * 

> 13. Address: Jastak Associates, Inc., 1526 Gilpin ^\ve., Wilmij^ton7D^|9806 

* * 14. Cost: Work Sample Set $1,698!00 * 
Manual 22.00 • \. . 

S Resupply-Kit 99.00 * 

Record Forms (50) 6.90 
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J SECTION E 

EXPLORING THE RESOURCES OF " 
THE UNITED STATES EMPLOYMENT SERVICE 



The following tests and techniques have been developed by the U.S. Employment Service for 
measurement of occupational aptitudes and interests and clerical and literacy skills. 

- General Aptitude Test Battery (GA TB) consists of 1 2 tests measuring 9 vocational 
aptitudes. It measures the vocational aptitudes of individuals who have basic literacy 
• skills but who need help ill choosing an occupation.^ Spanish version (BEA(5) is 
available. 

• Specific Apthude f Test Batteries (SATB) consist of combinations of two, three, or four 
^jAT&aptitudes with associated cutting scores. More than 450 of thpse have been 

developed for use in selecting untrained or inexperienced applicants for referral to 
^specific jobs or occupational training/ » > 

■ • . . . ' jfr 

• Nonreading Aptitude Test BatteryiNATB) consists of 14 tQstsjneasurlng^the same 9 
aptitudes measured by the GATB. It was.developed for use wi^Fin^ividuals who do not 
have sufficient literacy skills to take thef GATB. * ( 

* * a r l 

• Clerical Skills Tests measure proficiency in typing, dictation, and spelling to determine 
^ the level of skills required in clerical jobs. * ^ ^ . 

• Basic Occupational Literacy Test (BOLT) consists of four parts: arithmetic computation, 
arithmetic Reason ingyffeading vocabulary, and reading comprehension. It measures the 
literacy skills of educationally deficient applicants and can be related to the ItW^cy* 
requirements of occupations., ' 



r 



BOLT Wide Range Scale (see GATB-NATB Screening Device) is used as ag indicator of 
appropriate levels of BQLT subtests to administer and as a device to defcj-mine whgtbei 
the GATB or NAT? woujd be more appropriate for a given individuals The Wid^ftange 
Scal&may be administered individually by the counselor or group administered 'in the 
testingxinit: The Scale takes about iifteen minutes to administer and is scored separately 
for vocabulary and arithmetic? . . _ • * 

Pretesting Orientation Techniques are used in orienting the applicant to the testing 
situation. The techniques include a booklet»"Doing Your Best on Aptitude Tests," 
available in English atid Spanish; a booklet "Doing Your Best on Reading and Arith- 
metic Tests;" a miniature-aptitude test battery "Pretesting Orientation Exercises;" and 
an illustrated lectUre-discussiotoechnique "Protesting Orientation on the Purpose of 
Testing,'' available in English and/Spanish. ^ ' 

JEVS Work Sample Assessment consists of a series of work.tasks, & structure environ- 
ment in whicjv they are performed, and an evaluation of the client's behavior based on i 
observations. This technique, developed through contract with Jthe Jewish Employment,, 
and Vocational Service of Philadelphia, is designed for usejin developing the employ- j 
ability of disadvantaged individuals. ' ^ ^ | 

m .... •( * 
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, * • Interest Check List (ICL) consists of 173 sample ^asks representing a broad range of 
occupational activities. It is used as an interviewing aid to obtain information on the 
* range of an applicant's occupational interests. 

Several of these tests and assessment techniques have been described elsewhere in the guidebook. 
Items.on the subsequent pages include the tests not noted previously. 

A. S 

72. GENERAL APTITUDE TEST BATTERY (GATB) AND SPECIFIC APTITUDE TEST 
BATTERIES (SAT B) 

The GAT3 consists of twelve tests measuring nine occupational aptitudes, as follows: 

. 1. General ^earning Ability (G) - The ability to "catch on" or understand instructions afld 
underlying principles; the ability to reason and make judgments (measured by Part"3-Three 
Dimensional Space; Part 4— VocabuJary; Part 6-Artthmetic Reason). * 

2. Verbal Aptitude (V) - The ability to understand meaning of words and^deas associated 
with them and the ability to use them effectively. The ability to comprehendlanguage, tt> 
understand relationships between words, and to understand meanings of whole sentences 
and paragraphs. The ability to present information or ideas clearly (pleasured by Part 4- 
Vojfabulary). ^ ^ ✓ 

3. Numerical Aptitude (N) - Ability to perform arithmetic operations quickly and accurately. 
* (measured by Part 2-Computation; Pary 6— Arithmetic Reason) 

4. Spatial Aptitude (S) -"Ability to comprehend forms in space ancfunderstand relationships 
% of plane and solid objects. Frequently described as the ability to "visjualize" objects of two. 

or three dimensions, or to "think visually of geometafc 'forms (measured by Part 3-Tjiree 
DimensionaJ Space).. > * • j 

5. Form Perception (P) Abijity to perceive pertinent details in objects or in pictorial or 
grapl^c material. Ability to make visual comparisons and discriminations and see slight 
differences in shapes and shadings of figures and widths and lengths of lines (measured by 
Part 5-Tool Matching'; F4rt 7-Form Matching). 

• < • 

6. Clerical Perception (Q) — Ability to perceive pertinent detail in verbal or tabular material. 
r Ability to observe differences in copy, T to proofread words and numbers, and to avoids 

perceptual errors in arithmetic computation (measured by Part 1— Name Comparison). » 

7. Motor Coordination (K) — Ability to coordinate eyes and hands or fingers rapidly and 
accurately in making precise movements with speed. Ability to make a movement response 
accurately and swiftly (measured by Part 8— Mark Making).. - 

8. Finger Dexterity (F) - Ability to move the fingers and manipulate small objects with the 
fingers rapidly and accurately (measured by Part 13 -Assemble; Part 1 2— Disassemble). 

9. Manual Dexterity (M) — Ability to move the hands easHy and skillfully. Ability to work 
with the hands in placing and turoing motions (measured by Part 9-Place; Part 10-Turn). 



126 121 



> 



/ 



Finger dexterity and manual dexterity are measured with the use of apparatus tests, while tlge other 
aptitudes are measured by paper-and-pencil tests. - » * • / * , 

The Manual for the USES General Aptitude Test Battery (U.S. Department of Labor, 1970) consists 
of separately bound sections, theV are as follows. Section I - Administration and Scoring, Section II - 
Occupational Aptitude Pattern Structure; Section 1 1 1 - Development; and Section IV - Norms: 
Specific Occupations. * * * ? - 

Since its publication in 1947, the GAf B has been researched in a continuing program of development 
and occupational validation/This research has produced over 450 Specific Aptitude T6st Batteries' 
(SATBs), consisting of combinations ot two, three, oK four apllitudes^ith associated cufting scores 
tor specific'^ftcupations and a system of QccupatjonafcAptitude PatternsJOAPs} consistrng of combi 
.nations of thrEe apjtitiides with assdcfated cutting sCQres for groups of occupations. A description df 
4 f bis research is contained in the Manual for the USES General Aptitude Test Battery, 'Section III: 1 ' 
Development. * * V 

Because of the^possibility that SATBs might be invalid and/or unfajV for minority groups/current 
,pmphasis is being placed*on revalidating existing SATBs using samples that include subgroups of 
minorities large enough to permit separate statistical analysis. SATBs revalidated with such samples . 
(some two dozen by mid- 1976) havie demonstrate fain?£ss and validity for minority groups. 

.Research is Beinc) completed to develop a new Spanish edition of the GATB. This new edition, the 
/ Bateria de Examenes de Aptitud General (BEAG), is designed to h^Ve general applicability for use 
l&vith Spanish-speaking ES applicants, including those in Puerto Rico. 

y " . * * ' 

Administration^ the entire GATB requires about two and one-quarter hours. All the'paper-and- 
pencil tests, except Part 8, are arranged in two booklets for which answer sheets are provided. Part 8 
' is on a separate sheet and no answer sheet is required. Scoring stencils are used for hand scoring. Raw 
scores are converted c to aptitude scares by use of conversion tables. When more than one £est is used 
fo provide a measure of a given aptitude, the converted scores for each test are summed to obtain 
the aptitude score. ~ '* > *- 

Occupational Aptitude Patterns (OAPs) are combinations oftnrse'GATB aptitudes with associated^ 
cutting scores. They indicate the aptitude requirements for groups of occupations. There are sixty- • 
tv\/o OAPs and tf)ey cover more than 1,200 occupations. The OAP-aptitude score matchirw process 
is described in detail in the Manual for the USES General Aptitude Test Battery, Section f: Adminis- . 
tration and Scoring. Specific Aptitude Test Batteries (SATBs) are combinations of tv/o, three, or 
four aptitudes with associated cutting scores, SATBs reflect aptitude requirements for specific oca?** 
pations against which an individual's aptitude scores can be matched. There are more than 450 SATBs, 
and the SATB-aptitude score-matching.process is the same as that for OAPs. 

USES CLERICAL SKILLS TESTS 

The six clerical skills tests measure skilfs important in a variety of cle\^il/>ccupatioris. The skills 
measured srar'typing from plain copy, ability to take dictation, gen^l spelling, statistical typing, 
medical spelling, and legal spellings — . * c , . 

1. The plain copy Jyping test consists of typing from a typed page containingtfwo letters for five 
minutes. Either a manual qi electric typewriter may be used, as the examine^prefers. The test 
content is typical of correspondence of S variety of types of employers. Six foWiris of the'typing 





test are available. The test yields separate measures of typing speed (words per minute and decile 
scores) and typing accuracy expressed as a decile score, which compares the examinee to 
experienced typists. 

>^ 

2. THte dictation test consists of two 200 word letters that are dictated at 60, 80, and 100 words 
per minute. Content of th'e letters is typiCalof correspondence if a variety of employers. 

9 Examinees take dictation orl stenographic ^notebooks in'the usual manner, but transcription is 
accomplished by marking a true-false answer sheet to-indicate whether certain words were or 
were not dictated. Twenty-five minutes are allowed to complete the true-false test. The test may 
be administered "live" or by standardized qscordings. Six forms of'the dictation test are available. 
The test yields an accuracy score expressed as a decile score to indicate how well the examinee 
was able to correctly identify selected words in the two passages as compared to secretaries and 

•stenographers generally. The number of dictated words per minute, at which the examinee tq6k 
dictation, is alsofreported, although this is not, strictly speaking, a score." 

3. Tl^ie spelling test consists of 90 words, some correctly spelled and some incoftectly spelled. The 
content is typical of words used in correspondence in a variety of employment situations. There 
are two forms of the general spelling test. The test yields an accuracy score expressed as a decile 
score which expresses the examinee's standing relative to a sample of experienced secretaries and 
stenographers. ' 

4. The statistical typing test consists of typing from numerical material in a columnar form for 10 
minutes on either a manual or an electric typewriter, as the examinee prefers. There is only one 
form of this test. The test yields speed and accuracy scores expressed as a decile score, which 
allows comparison of the examinee to experienced typists who spend at least 10 percent of their 
time typing tabular material. 

9 

5. The medical spelling test consists of 40 medical terms that are read aloud by the examiner, using 
a pronunciation guide, and spelled out by examinees on an answer form. The test yields an 
accuracy score expressed as a decile, which allows comparison of the examinee to employed 
workers ir^ the medical/clefical field. 

6. The legal spelling test consists of 40 legal terms that are read aloud by the examiner using a 
pror*nciatior> guide and spelled out by, examinees on an answer form. The test yfelds an accuracy 
scor^ expressed as a decile, which allows comparison of examinee's performance with performance 
of employed workers in the legal/clerical field. 

The Manual for USES Clerical Skiffs Tests (U.S. Department o{ Labor, 1976) consists of two 
separately bound sections, as follows: fc 

• • Section 1 : Administration, Scoring.and Interpretation: Contains procedures for adminis : 
tration add scoring of the six clerical skills tests and guidelines for interpreting and using 
the test results. 

• Section 2: Development: Contains detailed technical information on the development of 
% each of the clerical skills tests.* 

✓ * 
Instructions for administering and scoring each of the clerical skills tests are found in Section 1 of 
the Manual forVSES Clerical Skills Tests. The norm tables fo«ach test are used to correct raw 
scores to deciles based on representative samples of experienced workers. 
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Section 1 of the Manual for the USES Clerical Skills Tests provides information on use and interpre- 
tation. Much of the use for clerical skills tests is self evident; if a clerical job includes the task 
stneasured to "a significant extent," the test will be useful in placement in tjje job. However, judg- 
ment enters into use in determining what "a significant extent" really means. * 

The norms are based an test performance of experienced workers and a lower grade score is 
expectecTfor new and inexperienced workers. It may require some persuasive ability to convince an 
employer that clerical skills develop over time and that an entry clerical worker, on the average, will 
score lower than an experienced worker. 



74. USES INTEREST CHECKLIST 

The checklist is an interviewing aid used to obtain informatiQn on the range of vocational interests 
of a counselee. It is particularly useful with persons who have no definite work interests or who have 
limited knowledge of the variety of jobs and occupational fields. The checklist enumerates 173 items 
that have been taken without alteration in wording or sequence and keyeci to the Worker Trait Agree- 
ment (WTA) and Occupational Group Arrangement (OGA) of the third edition of the Dictionary of 
Occupational Titles. The numbers in parentheses underneath each group of items in the checklist refer 
to WTA and OGA classifications which should be explored with the counselee when responses indicate 
an interest in the activities described. The checklist should'be administered in accordance with the 
separately published Instructions for Administering and Using the Interest Checklist. 

No score is obtained from the checklist. It is not a test, but rather an interviewing aid. It is an 
exploratory^device through which the counselor and counselee can investigate together the range of 
vocational interests of th§ counselee. Details of interpretation are co.ntained in the Instructions for 
Administering and Using the Interest Checklist. 

In addition, an occupational interest inventory oriented to the 4th edition of the Dictionary of 
Occupational Titles has been developed. The objective is to make available to vocational counselors 
an interest inventory with scales for measuring an applicant's occupational interests that will relate 
directly to DOT,areas of work. 
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APPENDIX A 

LEARNING FROM THE EXPERIENCES 
• ; OF OTHERS ^ 



In order to learn frorri the experiences of otters, a number of telephone* interviews were con- 
ducted with twenty practitioners throughout the Jjountry. Since the sample was small, broad general- 
izations cannot be made. Nevertheless* these opinions provide some interesting insights and are 
therefore included (although not everyone might agree with them)..We strongly urge testing coordi- 
nators to conduct similar surveys and to contact users of specific tests that are being considered for 
selection or in the case of work samples, possible adaptation. The sample comments listed belov* 
have been reconstructed from the notes of theAelephone conversations. 

■ * ^- ' 

Staff Training 

Professional people must be involved in the assessment process. They really have to know* what 
, they are doing, and therefore, they should be trained at the master's level. Special expertise is 
needed. 

f 

One cannot be ignorant of the assessment tools, so inservice training is needed. We need to 
learn the basic principles of assessment, e.g., objectivity and reliability. But we also need to 
be familiar with the assessment process arici not just psychometry . 

Grade Scores 

, It is important to focus on the actual competencies of the participants* But often this is ^ . 
masked by grade equivalent scores that lead to negative self-esteem. Yhe concept of grade 
equivalencies is inappropriate, especiall^for disadvantaged populations. It is unfortunate that 
some tests put out results in grade equivalents. #J 

Using Tests ^ 

We try- to work closely with counselors who should use the test results as on|y one factor in 
assessing participants. The counselors should be professionals who understand how to interpret 
results. In our case, they ace called base counselors; that is, persons who work with the partici- 
pants throughout the entire process. They must keep in mind that some people simply don't 
test well. In addition, those who give the tests should know how to look for clues. For example, 
if they test older people, 'they should be aware of possible vjsio'n problems. 

Obviously, when dealing with a machine-in using a work sample approach, for exaniple-it is 
easy to forget the human element* the-people who bring problems in with them. You bave to 
make sure the individual is counseled and trained well; especially those with drug, alcohol, or 
psychological problems. You should not use assessment in isolation; that is, ypu need to have 
aerogram to go along with the testing, e.g., a syllabus on getting and keeping a job. * ' ■ ° N 
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No test, no matter which, is a panacea. The value of a test depends on the level of the persons 
tested, especially disadvantaged persons. Even the appearance and length of a test is important; 
if it looks too complicated, be careful. Look at the results with common sense and remember 
that a test should not "make or break" a person. Counselors should remember that it is not a 
life or death matter. Remember, too, that some people are test takers and some are not; some 
very smart people freeze in a test situation. x f 

Seject your counselors carefully-and counsel carefully. Since different participants respond 
better to different tests; you need an arsenal of tests and fjgople to determine which to use. You 
should have a file cabinet of tests and try them out. Make certain the tests are culture-free and 
make certain you stay in compliance with the Equal Employment Office (EEO) requirements. 

Counselors should have a background in education or rehabilitation and must enjoy working 
with people. We need to be concerned with an individual's performance more than anything 
else; that is, we should consider the flexible use of time in an open-entry, open-exit, fashion. 
Training should be based on performance. • * • 1 ' 

You need interchange with the participants. Talk to them about what they thought of the test. 
Also, and this is most important, whatever time the participants spend in the program should be 
a paid activity. It should be extended as long as is necessary for participants to finish the training 
needed. Time flexibility is essential. * 

Do not place evaluation in concrete. Look at areas other than testing. Do not stand just on an 
evaluation. Place the emphasis on client characteristics as related to worker characteristics; that 
is, by using DOT traits. For example, how well does he or she work with others? What are his 
♦ or her interpersonal relations? Also, follow up after placement to see how they are doing. Set 
it up so that the participants make the decisions on what areas are to be evaluated. 

Tests won't tell you that many specifics, but they will give you some good general directions. 

♦The major point to understand is that tests provide actual performance data on any certain 
date. The tester's job is merely to offer an opiriTbn. Do not be god-like. One must temper one^ 
opinions. Tests are just one tool in counseling. The results are not to be taken as gospel. 
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APPENDIX B 

STUDYING THE RELATED STANDARDS 
OF THE AMERICAN 
PSYCHOLOGICAL ASSOCIATION . 



Standards for Educational and Psychological Tests, Washington, DC: American Psychological 
1 Association, Inc., 1974. 

Thfe standards were developed jointly by the American Psychological Association, the American 
Educational Research Association, and the National Council on Measurement in Education. They 
include a number of useful guidelines for test users. The standards include items grouped into the 
following areas: 

1) standards for tests, manuals, and reports — dissemination of information regarding tests; 
aids to interpretation;*Jirections for administration and scoring; norm£ and scales; ' 

2) standards for reports on research on reliability and validity -'validity; reliability and 
measurement error; 

3) standards for the use pf tests — qualifications and concerns of users; choice or development 
' of test or mlfchod; administration and scoring; and interpretation of scores. 

mm The explanation in the parentheses after the standards are the levels suggested by the APA. 
— * » • • 

Qualifications and Concerns of Users 

• G1. A test user should have a general knowledge of measurement principles and of the limitations 
of test interpretations, (essential) - 

• G2. A test liser should know and understand the literature relevant to the tests he/she uses and 
the testing problems with whiqh he/she deals, (very desirable) 

• G3. One who has the responsibility for decisions about individuals or policies that are based on 
test results should have an understanding of psychological or educational measurement and of 
validation and other test research, (essential) * . 

i G4. Test^jsers should seek to avoid bias in test selection, administration; and interpretation; they 
should try to avoid even the appearance of discriminatory practice, (essential)' 

• G5, Institutional test users should establish procedures for periodic internal review of testuse. 
(essential) t 

Choice of Development of Test or Method 1 , , 

-> 

• H1. The choice or development of tests, test batteries, or other assessment procedures should be 
based on clearly formulated goals ajid hypotheses, (essential) 

• H2. A test user should consider more than one variable for assessment and the assessment of any , 
given variable by more than one method, (essential) * 



135 

128 



• H3,. In choosing an existing test, a user shou Id-relate its history of research anddevejopment to 
his intended use of the instrument, (essential) 

• H4. In general a test user should try to choose or to develop an assessment technique in which 
"tester-effect" is minimized, or wi which reliability of assessment across testers can be assured. ^ 
(essential) 

X' ^ > 

Administration'and Scoring ~ f 

• « 

• 1 1 . A test userls-expected to follow carefully the standardized procedures described in the 
manual for administering- a' test, (essential) 

• 12, The test administrator is responsible for establishing conditions consistent with the principle 
of standardization, that enables each examinee to do his/her best, (essential) 

" * * 

• 13. A test user is responsible for accuracy-in scoring, checking, coding, or recording test results, 
(essential) " * 

• 14. If specifjc cutting scores are to be used as a basis for decisions, a test user should have a 
rationale, justification, or explanation of the cutting scores adopted, (essential) * 

• 15, The test user shares with the test developer or distributor a responsibility for maintaining 
test security, (essential) ^ >^ 

Interpretation of Scores s 

• J1 . A test score should be interpreted as an estimate of performance under a given set of circun*-';- 
stances. It should not be interpreted as some absolute characteristic of the examinee or as something 
permanenrand generalizable to all other circumstances, (essential) 

• J2. Test scores should ordinarily be reported only to people who are qualified to interpret them. 
If scores are reported, they should be accompanied by explanations sufficient for the recipient to, 
interpret them correctly, (essential) N 

• J3. The test user should recognize thatrestimates of reliability do not^dicate criterion-related 
validity, (essential) 
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• J4. A test user should examine carefully the rationale and validity of computer-based interpreta- 
tions of test scores, (essential) «« 

• J5. In norm -referenced interpretations, a test user should inferpret an obtained score with refer- 
ence to setsof norms appropriate for the individual tested and for, the intended use. (essentfel) 

• J6, Any content-referenced interpretation shoufd clearly indicate the domain to which^ne can 
generalize, (essential) 1 \ 

• J7. The test user should copsider alternative interpretations of a given scoref(essential) 

• J8. The test user should be able to interpret test performance relative to other measures, (very 
desirable) • ' 
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• J9. A test user should develop procedures for systematically eliminating from data files test- 
score information that has, because of the lapse of time, become obsolete, (essential) 
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From the Standards for Educational and Psyc/iologica/ Tests. Washington D C ■ 
American Psychological Association, Inc. Copyright 1974 by the American Psycho- 
logical Association. Reprinted by permission. * . 
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